Overview
ChatGPT 3.5 Turbo 16k is an enhanced version of the GPT-3.5 Turbo model, featuring a larger context window of 16,000 tokens. This allows for more extensive and coherent interactions, making it particularly suited for complex conversations, detailed content generation, and tasks requiring long-form input or multi-turn dialogue.
Specializations
Expands the context window to 16,384 tokens, enabling it to process larger inputs and maintain context over extended dialogues.
Ideal for complex tasks requiring detailed information processing without losing coherence.
Balances performance with cost-effectiveness, suitable for high-demand environments.
Integration Guide (Javascript)
To use this model through Portkey, follow these steps:
1. Install Portkey SDK:
npm install --save portkey-ai
2. Set up client with Portkey:
import OpenAI from 'openai';
import { PORTKEY_GATEWAY_URL, createHeaders } from 'portkey-ai'
const openai = new OpenAI({
apiKey: 'OPENAI_API_KEY',
baseURL: PORTKEY_GATEWAY_URL,
defaultHeaders: createHeaders({
provider: "openai",
apiKey: "PORTKEY_API_KEY"
})
});
3. Make a request:
const chatCompletion = await openai.chat.completions.create({
messages: [{ role: 'user', content: 'Say this is a test' }],
model: 'gpt-3.5-turbo-16k',
});
console.log(chatCompletion.choices[0].message.content);
Model Specifications
Release Date:
13/6/2023
Model Variants:
gpt-3.5-turbo-16k-0613
Max. Context Tokens:
16K
Max. Output Tokens:
4K
Knowledge Cut-Off Date:
September 2021
MMLU:
70
%
License:
Proprietary
Pricing
$/Million Input Tokens
$
3
$/Million Output Tokens
$
4
Live updates via Portkey Pricing API. Coming Soon...
© 2024 Portkey, Inc. All rights reserved