Overview
LLaMA 3.1 70B Versatile builds on the strengths of its predecessor, offering enhanced algorithms for improved accuracy and fluency. This model is particularly effective in diverse applications, including coding and multilingual tasks, making it a versatile tool for developers and researchers.
Specializations
Versatile Model: Capable of various natural language tasks.
Large-Scale Model: Powerful capabilities for complex tasks like translation and summarization.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Groq Virtual Key created in Portkey
})
3. Make a request:
// Make a chat completion request
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/llama-v3p1-8b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1248
Arena Score
LMSys Leaderboard Rank:
18
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
23/7/2024
Max. Context Tokens:
128K
Max. Output Tokens:
8K
Model Size
70B
Knowledge Cut-Off Date:
December 2023
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1248
Pricing
$/Million Input Tokens
$
0.59
$/Million Output Tokens
$
0.79
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved