Llama-3.1-70B-Instruct

MetaMCP Tool Call
meta/llama-3.1-70b-instructOpen Weights

Open Llama instruction model for multilingual chat, reasoning, and coding

Benchmark Pricing$0.72 / 1M in$0.72 / 1M out
Context: 128,000 tokens•Max Output: 4,096 tokens•Knowledge: 2023-12•Released: 2024-07-23

TECHNICAL SPECIFICATIONS

Context Window128,000128K tokens
Max Output4,0964.1K tokens
LicenseOpen SourceSelf-hostable
Input Modalities
Text
Function / Tool CallingSupported (MCP Ready)
Structured OutputsGuaranteed Schema

MODEL CONTEXT PROTOCOL (MCP) READINESS

✓ Llama-3.1-70B-Instruct natively supports OpenAI / Anthropic format tool calling and is fully compatible with MCP servers and agent loops.

MCP Context Window Recommendations

With a context capacity of 128,000 tokens, this model can handle moderately large MCP tool definitions and multi-turn conversation logs comfortably.

API CALL INVOCATION EXAMPLE

// Example: Calling Llama-3.1-70B-Instruct via OpenAI SDK
import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.META_API_KEY,
});

const response = await client.chat.completions.create({
  model: "meta/llama-3.1-70b-instruct",
  messages: [{ role: "user", content: "Hello! Can you inspect MCP tools?" }],
});

console.log(response.choices[0].message.content);

PRICING BY PROVIDER

5 providers
LLM Gatewayaws-bedrock/llama-3.1-70b-instruct
$0.72 / $0.72
Merge Gatewaymeta/llama-3.1-70b-instruct
$0.99 / $0.99
Kilo Gatewaymeta-llama/llama-3.1-70b-instruct
$0.40 / $0.40
DevPass (LLM Gateway)llama-3.1-70b-instruct
$0.72 / $0.72
OpenRoutermeta-llama/llama-3.1-70b-instruct
$0.40 / $0.40

Rates in USD per 1M tokens. Rates synchronized from models.dev public catalog.