Overview
The Llama 3.2 1B Instruct model is a lightweight version with just 1 billion parameters, optimized for instruction-following tasks while being suitable for deployment on edge devices. This model maintains the same advanced training techniques as its larger counterparts, including SFT and RLHF, ensuring it can understand and execute a wide range of natural language instructions effectively. With support for multilingual capabilities across eight languages, the Llama 3.2 1B Instruct is particularly valuable for applications requiring efficient processing in resource-constrained environments.
Specializations
Lightweight Model: Ideal for resource-constrained devices.
Multilingual Capabilities: Strong performance in various languages.
Instruction-Tuned: Optimized for following instructions and generating text.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey
})
3. Make a request:
// Make a chat completion request
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/llama-v3p2-1b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1061
Arena Score
LMSys Leaderboard Rank:
104
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
25/9/2024
Max. Context Tokens:
128K
Max. Output Tokens:
8K
Model Size
1B
Knowledge Cut-Off Date:
December 2023
License:
Open-Source
LMSys Elo Score
1061
© 2024 Portkey, Inc. All rights reserved