WizardLM 2 8x22B
by
WizardLM
Model ID:
microsoft/WizardLM-2-8x22B
Overview
WizardLM 2 8x22B is Microsoft AI's latest iteration in the Wizard series, featuring a 22 billion parameter architecture. It is fine-tuned for instruction-following tasks and demonstrates competitive performance against leading proprietary models, making it a strong choice for advanced language generation applications.
Specializations
Mixture of Experts Architecture: This model utilizes a Mixture of Experts (MoE) architecture, allowing it to dynamically activate only a subset of its parameters for each task, enhancing efficiency and performance.
Multilingual Capabilities: WizardLM 2 excels in handling multilingual tasks, making it suitable for diverse applications that require language support across different regions.
High Performance on Complex Tasks: It demonstrates impressive capabilities in reasoning and agent tasks, outperforming many existing state-of-the-art open-source models in various benchmarks.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your DeepInfra Virtual Key created in Portkey
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'microsoft/WizardLM-2-8x22B',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1106
Arena Score
LMSys Leaderboard Rank:
79
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
15/4/2024
Max. Context Tokens:
128K
Model Size
22B
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1106
Pricing
$/Million Input Tokens
$
0.5
$/Million Output Tokens
$
0.5
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved