Llama 3.2 3B Instruct

Llama 3.2 3B Instruct

Llama 3.2 3B Instruct

by

Meta

Model ID:

Llama-3.2-3B-Instruct

Use This Model

Model Overview

FAQs

Related Links

Overview

The Llama 3.2 3B Instruct model features 3 billion parameters and is specifically designed for instruction-following tasks in a text-only format. This model utilizes an optimized transformer architecture that allows it to generate coherent and contextually relevant responses based on user instructions. It has been fine-tuned using supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF), which enhances its ability to follow complex commands and provide helpful outputs. With a context length of up to 128,000 tokens, this model is capable of handling extensive input data, making it suitable for applications that require detailed interactions, such as chatbots or virtual assistants.

Specializations

  • Compact and Efficient: Designed for edge devices and mobile applications.

  • Multilingual Capabilities: Strong performance in various languages.

  • Instruction-Tuned: Optimized for following instructions and generating text.

Integration Guide (Javascript)

To use this model through Portkey, follow these steps:

1. Install Portkey SDK:

npm install --save portkey-ai

2. Set up client with Portkey:

// Import and initialize Portkey

import Portkey from 'portkey-ai'

const portkey = new Portkey({

  apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key

  virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey

})

3. Make a request:

// Make a chat completion request

const chatCompletion = await portkey.chat.completions.create({

  messages: [{ role: 'user', content: 'Say this is a test' }],

  model: 'accounts/fireworks/models/llama-v3p2-3b-instruct',

});

console.log(chatCompletion.choices);

Live API Statistics and Performace Metrics

LMSys Arena Elo Score:

1105

Arena Score

LMSys Leaderboard Rank:

83

Arena Rank

Evaluates LLMs through a combination of user feedback and automated scoring systems.

Model Specifications

Release Date:

25/9/2024

Max. Context Tokens:

128K

Max. Output Tokens:

8K

Model Size

3B

Knowledge Cut-Off Date:

December 2023

License:

Open-Source

LMSys Elo Score

1105

© 2024 Portkey, Inc. All rights reserved