Overview
Command R is a versatile generative AI model with improved performance in multilingual RAG, tool use, math, code, and reasoning. It offers 50% higher throughput and 20% lower latency compared to its previous version, while reducing hardware requirements by half. This model excels at structured data analysis and creation, and features enhanced instruction following and robustness. Suitable for a wide range of applications requiring efficient, capable AI assistance.
Specializations
Optimized for long-context tasks and external tool integration.
Strong performance in retrieval-augmented generation (RAG) scenarios.
Balanced combination of high accuracy and computational efficiency.
Capable of handling complex language tasks with extended context (up to 128,000 tokens).
Designed for scalable production environments.
Robust multi-lingual capabilities.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY",
virtualKey: "VIRTUAL_KEY" // Your Cohere Virtual Key
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'command-r-08-2024',
});
console.log(chatCompletion.choices[0].message.content);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1171
Arena Score
LMSys Leaderboard Rank:
48
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
30/8/2024
Max. Context Tokens:
128K
Max. Output Tokens:
4K
License:
Proprietary
Technical Report/Model Card:
LMSys Elo Score
1171
Pricing
$/Million Input Tokens
$
0.15
$/Million Output Tokens
$
0.6
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved