Overview
Jamba 1.5 Large is a powerful hybrid SSM-Transformer model developed by AI21 Labs. With 94 billion active parameters (398 billion total), it excels at long-context handling, offering a 256K token context length. The model demonstrates superior performance on various benchmarks and supports multiple languages. Jamba 1.5 Large is optimized for business use cases, including function calling and structured output, while delivering up to 2.5X faster inference than comparable models.
Specializations
Powerful and efficient long-context model: It offers superior performance and efficiency in handling long-form content, making it suitable for tasks like summarization, translation, and content generation.
Hybrid SSM-Transformer architecture: This architecture enables it to achieve state-of-the-art performance and efficiency.
Optimized for business use cases: It supports features like function calling, structured output, and grounded generation, making it well-suited for various business applications.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your AI21 Labs Virtual Key created in Portkey
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'jamba-1.5-large',
});
console.log(chatCompletion.choices);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1220
Arena Score
LMSys Leaderboard Rank:
26
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
22/8/2024
Max. Context Tokens:
256K
Model Size
94B
Knowledge Cut-Off Date:
March 5, 2024
MMLU:
81.2
%
License:
Open-Source
Technical Report/Model Card:
LMSys Elo Score
1220
Pricing
$/Million Input Tokens
$
2
$/Million Output Tokens
$
8
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved