LLaMA 3.1 70B Instruct

LLaMA 3.1 70B Instruct

LLaMA v3.1 70B Instruct

by

Meta

Model ID:

Llama-3.1-70b-instruct

Use This Model

Model Overview

FAQs

Related Links

Overview

LLaMA v3.1 70B Instruct is optimized for complex instruction-following scenarios, boasting 70 billion parameters. This model excels in tasks requiring detailed understanding and is suitable for applications in customer support and interactive AI systems.

Specializations

  • Instruction-Tuned: Optimized for following instructions and generating text.

  • Large-Scale Model: Powerful capabilities for complex tasks.

Integration Guide (Javascript)

To use this model through Portkey, follow these steps:

1. Install Portkey SDK:

npm install --save portkey-ai

2. Set up client with Portkey:

// Import and initialize Portkey

import Portkey from 'portkey-ai'

const portkey = new Portkey({

  apiKey: "PORTKEY_API_KEY", // Replace with your Portkey API key

  virtualKey: "VIRTUAL_KEY" // Your Fireworks Virtual Key created in Portkey

})

3. Make a request:

// Make a chat completion request

const chatCompletion = await portkey.chat.completions.create({

  messages: [{ role: 'user', content: 'Say this is a test' }],

  model: 'accounts/fireworks/models/llama-v3p1-8b-instruct',

});

console.log(chatCompletion.choices);

Live API Statistics and Performace Metrics

LMSys Arena Elo Score:

1248

Arena Score

LMSys Leaderboard Rank:

18

Arena Rank

Evaluates LLMs through a combination of user feedback and automated scoring systems.

Model Specifications

Release Date:

23/7/2024

Max. Context Tokens:

128K

Max. Output Tokens:

8K

Model Size

70B

Knowledge Cut-Off Date:

December 2023

MMLU:

76.8

%

License:

Open-Source

Technical Report/Model Card:

LMSys Elo Score

1248

Pricing

$/Million Input Tokens

$

0.9

$/Million Output Tokens

$

0.9

Live updates via Portkey Pricing API. Coming Soon...

© 2024 Portkey, Inc. All rights reserved