Llama 3.1 Nemotron Safety Guard 8B v3

NVIDIA

nvidia/llama-3.1-nemotron-safety-guard-8b-v3Open Weights

Safety model for policy screening, moderation, and risk-aware routing workflows

Benchmark Pricing$0.00 / 1M in$0.00 / 1M out

Context: 128,000 tokens•Max Output: 4,096 tokens•Released: 2025-10-28

TECHNICAL SPECIFICATIONS

Context Window128,000128K tokens

Max Output4,0964.1K tokens

LicenseOpen SourceSelf-hostable

Input Modalities

Text

Function / Tool CallingNot Supported

Structured OutputsPrompt Based

MODEL CONTEXT PROTOCOL (MCP) READINESS

⚠ Llama 3.1 Nemotron Safety Guard 8B v3 does not natively advertise tool-calling capabilities. When connecting to MCP servers, function calling must be handled via structured prompt injection.

MCP Context Window Recommendations

With a context capacity of 128,000 tokens, this model can handle moderately large MCP tool definitions and multi-turn conversation logs comfortably.

API CALL INVOCATION EXAMPLE

// Example: Calling Llama 3.1 Nemotron Safety Guard 8B v3 via OpenAI SDK
import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.NVIDIA_API_KEY,
});

const response = await client.chat.completions.create({
  model: "nvidia/llama-3.1-nemotron-safety-guard-8b-v3",
  messages: [{ role: "user", content: "Hello! Can you inspect MCP tools?" }],
});

console.log(response.choices[0].message.content);