Overview
Qwen 2 72B Instruct is a highly capable instruction-tuned model with 72 billion parameters, designed for superior performance in coding and mathematics. It supports an extended context length of up to 128K tokens, making it suitable for intricate tasks that require deep contextual understanding.
Specializations
Large model size: With 72 billion parameters, it offers a large capacity for learning and generating complex text outputs.
Instruction-following capabilities: It is fine-tuned to follow instructions effectively, making it suitable for tasks like summarization, translation, and content generation.
Strong performance across various tasks: It demonstrates strong performance in tasks like text generation, translation, and code generation.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Together AI Virtual Key created in Portkey
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'Qwen/Qwen2-72B-Instruct',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1187
Arena Score
LMSys Leaderboard Rank:
44
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
6/6/2024
Max. Context Tokens:
128K
Model Size
72B
MMLU:
84.2
%
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1187
Pricing
$/Million Input Tokens
$
0.9
$/Million Output Tokens
$
0.9
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved