Overview
Mixtral 8x22B Instruct is a powerful model featuring a 22 billion parameter architecture, designed for complex instruction-following tasks. It balances high performance with versatility, making it suitable for a wide range of applications, from creative writing to technical problem-solving.
Specializations
Mixture-of-Experts (MoE) architecture: This architecture allows the model to efficiently utilize a large number of parameters, leading to improved performance and efficiency.
Instruction-following capabilities: It is fine-tuned to follow instructions effectively, making it suitable for tasks like summarization, translation, and content generation.
State-of-the-art performance: It demonstrates state-of-the-art performance in various benchmarks, making it a powerful and versatile model.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey
}
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'accounts/fireworks/models/mixtral-8x22b-instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1147
Arena Score
LMSys Leaderboard Rank:
61
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
28/4/2024
Max. Context Tokens:
32K
Max. Output Tokens:
4K
Model Size
22B
Knowledge Cut-Off Date:
October 2021
MMLU:
77.75
%
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1147
Pricing
$/Million Input Tokens
$
1.2
$/Million Output Tokens
$
1.2
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved