Overview
The Llama 3.2 3B Instruct model features 3 billion parameters and is specifically designed for instruction-following tasks in a text-only format. This model utilizes an optimized transformer architecture that allows it to generate coherent and contextually relevant responses based on user instructions. It has been fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), which enhances its ability to follow complex commands and provide helpful outputs. With a context length of up to 128,000 tokens, this model is capable of handling extensive input data, making it suitable for applications that require detailed interactions, such as chatbots or virtual assistants.
Specializations
Compact and Efficient: Designed for edge devices and mobile applications.
Multilingual Capabilities: Strong performance in various languages.
Instruction-Tuned: Optimized for following instructions and generating text.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey
})
3. Make a request:
// Make a chat completion request
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/llama-v3p2-3b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1105
Arena Score
LMSys Leaderboard Rank:
83
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
25/9/2024
Max. Context Tokens:
128K
Max. Output Tokens:
8K
Model Size
3B
Knowledge Cut-Off Date:
December 2023
License:
Open-Source
LMSys Elo Score
1105
© 2024 Portkey, Inc. All rights reserved