Overview
GPT-4o Mini is a compact version of the GPT-4 architecture, designed for efficient performance while maintaining high-quality text generation capabilities. It is particularly suitable for applications requiring quick responses and lower resource consumption, making it ideal for mobile and embedded systems.
Specializations
Cost-effective performance: GPT-4o Mini is designed to deliver impressive results at a lower cost compared to larger models like GPT-4. This makes it accessible for a wider range of applications and businesses.
Multimodal capabilities: While not as extensive as GPT-4, GPT-4o Mini can handle both text and image inputs, enabling it to process and generate information in various formats.
Enhanced reasoning abilities: GPT-4o Mini demonstrates improved reasoning skills compared to its predecessors, allowing it to tackle more complex tasks and provide more insightful responses.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
import OpenAI from 'openai';
import { PORTKEY_GATEWAY_URL, createHeaders } from 'portkey-ai'
const openai = new OpenAI({
apiKey: 'OPENAI_API_KEY',
baseURL: PORTKEY_GATEWAY_URL,
defaultHeaders: createHeaders({
provider: "openai",
apiKey: "PORTKEY_API_KEY"
})
});
3. Make a request:
const chatCompletion = await openai.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'gpt-4o-mini',
});
console.log(chatCompletion.choices[0].message.content);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1273
Arena Score
LMSys Leaderboard Rank:
7
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
18/7/2024
Model Variants:
gpt-4o-mini-2024-07-18
Max. Context Tokens:
128K
Max. Output Tokens:
16K
Knowledge Cut-Off Date:
October 2023
MMLU:
82
%
License:
Proprietary
Technical Report/Model Card:
LMSys Elo Score
1273
Berkeley Function Calling Ability Score:
NaN
Pricing
$/Million Input Tokens
$
0.15
$/Million Output Tokens
$
0.6
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved