Overview
LLaMA 3 70B is a robust model designed for advanced language tasks, featuring 70 billion parameters. It demonstrates superior performance in understanding and generating text, making it ideal for applications that require nuanced comprehension and sophisticated dialogue capabilities.
Specializations
Instruction-Tuned: Optimized for following instructions and generating text.
Large-Scale Model: Powerful capabilities for complex tasks.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey
})
3. Make a request:
// Make a chat completion request
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/llama-v3p1-8b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1206
Arena Score
LMSys Leaderboard Rank:
34
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
18/4/2024
Max. Context Tokens:
128K
Max. Output Tokens:
8K
Model Size
70B
Knowledge Cut-Off Date:
December 2023
MMLU:
76.8
%
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1206
Berkeley Function Calling Ability Score:
NaN
Pricing
$/Million Input Tokens
$
0.9
$/Million Output Tokens
$
0.9
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved