Overview
LLaMA v3.1 8B Instruct is fine-tuned for instruction-following tasks, providing high-quality responses to user prompts. Its 8 billion parameters enable efficient processing while maintaining strong performance in generating coherent and contextually relevant text.
Specializations
Instruction-Tuned: Optimized for following instructions and generating text.
Mid-sized Model: Balanced performance and efficiency.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey
})
3. Make a request:
// Make a chat completion request
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/llama-v3-8b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1152
Arena Score
LMSys Leaderboard Rank:
58
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
18/4/2024
Max. Context Tokens:
128K
Max. Output Tokens:
8K
Model Size
8B
Knowledge Cut-Off Date:
March 2023
MMLU:
68
%
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1152
Pricing
$/Million Input Tokens
$
0.2
$/Million Output Tokens
$
0.2
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved