Gemini Flash 1.5 8b Exp (August 27th)
by
Model ID:
gemini-1.5-flash-8b-exp-0827
Overview
Released on August 27, 2024, gemini-1.5-flash-8b-exp-0827 is a preview release of Gemini 1.5 Flash-8B. The model has the same capabilities as Gemini 1.5 Flash but is likely a more compact or optimized version. gemini-1.5-flash-8b-exp-0827 allows developers to test a potentially more efficient implementation of the Flash variant.
Specializations
Features an 8 billion parameter architecture designed for high throughput in processing requests.
Focused on delivering quick responses while maintaining quality in generated content.
Ideal for deployment in scenarios requiring both speed and depth of understanding.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
import Portkey from 'portkey-ai'
const portkey = new Portkey({
apiKey: "PORTKEY_API_KEY",
virtualKey: "VIRTUAL_KEY" // Google Virtual Key
})
3. Make a request:
const chatCompletion = await portkey.chat.completions.create({
messages: [
{ role: 'system', content: 'You are a helpful assistant' },
{ role: 'user', content: 'Explain machine learning briefly' }
],
model: 'gemini-1.5-flash-8b-exp-0827',
});
console.log(chatCompletion.choices[0].message.content);
Live API Statistics and Performace Metrics
LMSys Arena Elo Score:
1205
Arena Score
LMSys Leaderboard Rank:
33
Arena Rank
Evaluates LLMs through a combination of user feedback and automated scoring systems.
Model Specifications
Release Date:
27/8/2024
Max. Context Tokens:
1049K
Max. Output Tokens:
8K
Model Size
8B
Knowledge Cut-Off Date:
November 2023
MMLU:
58.7
%
License:
Proprietary
Technical Report/Model Card:
LMSys Elo Score
1205
Pricing
$/Million Input Tokens
$
0.075
$/Million Output Tokens
$
0.3
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved