Overview
The Pixtral 12B represents Mistral's first foray into multimodal AI, featuring an impressive 12 billion parameters that enable it to process both images and text seamlessly. This model is designed to excel in tasks such as image captioning and object recognition, handling images at resolutions up to 1024x1024 pixels while also supporting a context length of up to 128,000 tokens. The Pixtral 12B incorporates a dedicated vision encoder that allows for effective analysis of visual data alongside textual inputs, significantly enhancing user interactions. By enabling flexible querying with both modalities, this model opens up new possibilities for applications in creative fields, content generation, and interactive AI systems. Its advanced capabilities make it a powerful tool for developers looking to integrate sophisticated multimodal functionalities into their projects.
Specializations
Multimodal capabilities: It can process and generate text and images, making it suitable for tasks like image captioning, image generation, and multimodal question answering.
Large context window: The 128k token context window enables it to process and generate longer, more coherent text and image outputs.
Open-source availability: Its open-source nature allows for customization and further development by the community.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
// Import and initialize Portkey
import Portkey from 'portkey-ai'
const portkey = new Portkey({apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key
virtualKey: "VIRTUAL_KEY" // Your Together AI Virtual Key created in Portkey
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'mistralai/pixtral-12B',
});
console.log(chatCompletion.choices);
Model Specifications
Release Date:
17/9/2024
Max. Output Tokens:
4K
Model Size
12B
License:
Open-Source
Technical Report/Model Card:
© 2024 Portkey, Inc. All rights reserved