Overview
The Ministral 3B is a cutting-edge AI model featuring 3 billion parameters, specifically designed for on-device and edge computing applications. This model excels in providing robust performance in multi-task language understanding, surpassing its predecessor, the Mistral 7B, across various benchmarks. One of its standout features is its ability to handle a context length of up to 128,000 tokens, allowing it to process extensive data inputs effectively. The compact size and efficiency of the Ministral 3B make it particularly well-suited for privacy-conscious applications, such as smart assistants and autonomous robotics, where local analytics are essential. Its optimized architecture enables quick responses and reliable performance, making it an ideal choice for developers seeking powerful AI capabilities in resource-constrained environments.
Specializations
High performance/price ratio: It offers excellent performance for its size, making it a cost-effective option for various applications.
Large context window: The 128k token context window enables it to process and generate longer, more coherent text outputs.
Multilingual support: It supports multiple languages, making it suitable for global applications.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Together AI Virtual Key created in Portkey
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'mistralai/ministral-3B',
});
console.log(chatCompletion.choices);
Model Specifications
Release Date:
9/10/2024
Max. Context Tokens:
4K
Model Size
3B
License:
Open-Source
© 2024 Portkey, Inc. All rights reserved