Llama-3.2-3B

Meta
meta/llama-3.2-3bOpen Weights

Small open Llama base model for lightweight text generation and self-hosting

Benchmark Pricing$0.03 / 1M in$0.05 / 1M out$0.02 cache read
Context: 131,072 tokens•Max Output: 8,192 tokens•Knowledge: 2023-12•Released: 2024-09-25

TECHNICAL SPECIFICATIONS

Context Window131,072131.1K tokens
Max Output8,1928.2K tokens
LicenseLlama 3.2 Community LicenseSelf-hostable
Input Modalities
Text
Function / Tool CallingNot Supported
Structured OutputsPrompt Based

MODEL CONTEXT PROTOCOL (MCP) READINESS

⚠ Llama-3.2-3B does not natively advertise tool-calling capabilities. When connecting to MCP servers, function calling must be handled via structured prompt injection.

MCP Context Window Recommendations

With a context capacity of 131,072 tokens, this model can handle moderately large MCP tool definitions and multi-turn conversation logs comfortably.

API CALL INVOCATION EXAMPLE

// Example: Calling Llama-3.2-3B via OpenAI SDK
import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.META_API_KEY,
});

const response = await client.chat.completions.create({
  model: "meta/llama-3.2-3b",
  messages: [{ role: "user", content: "Hello! Can you inspect MCP tools?" }],
});

console.log(response.choices[0].message.content);

PRICING BY PROVIDER

10 providers
NanoGPTmeta-llama/llama-3.2-3b-instruct
$0.03 / $0.05$0.02 cache
LLM Gatewaynovita/llama-3.2-3b-instruct
$0.03 / $0.05
Venice AIllama-3.2-3b
$0.15 / $0.60
Eden AIcloudflare/@cf/meta/llama-3.2-3b-instruct
$0.05 / $0.34
Kilo Gatewaymeta-llama/llama-3.2-3b-instruct
$0.05 / $0.33
DevPass (LLM Gateway)llama-3.2-3b-instruct
$0.03 / $0.05
Pioneermeta-llama/Llama-3.2-3B
$0.10 / $0.10$0.10 cache
Cloudflare Workers AI@cf/meta/llama-3.2-3b-instruct
$0.05 / $0.34
Inferencemeta/llama-3.2-3b-instruct
$0.02 / $0.02
OpenRoutermeta-llama/llama-3.2-3b-instruct
$0.05 / $0.34

Rates in USD per 1M tokens. Rates synchronized from models.dev public catalog.

Prompt Caching Active

This model supports prompt caching at $0.02 / 1M tokens, saving up to 50% on repetitive MCP tool definitions and system instructions.