Llama 3.1 Nemotron Nano 8B (v1): benchmark results

NVIDIA's reasoning and chat derivative of Meta Llama 3.1 8B Instruct, post-trained for reasoning, human preferences, RAG and tool calling. The publisher states a 131,072-token context; v1 remains distinct from later Nano releases. Provider: NVIDIA. Released 2025-03-18. Access: Open.

Aggregate Rating 1368 ± 34, rank #1324 of 1635 rated models, from 44 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Swallow - Post-trained English - MATH-50094.6Accuracy (%)47.8
SpeechMap Compliance60.1% Requests Completed46.3
ZeroEval MATH-50095.4MATH-500 Score43.8
Open Portuguese LLM - OAB Exams39.82Accuracy (%)42.4
Swallow - Post-trained English - AIME57.1Accuracy (%)41.8
Swallow - Post-trained Japanese - PolyMath High and Top28.8Accuracy (%)41.8
Swallow - Post-trained English - LiveCodeBench46.7Pass@1 (%)40.3
Open Portuguese LLM - ASSIN2 RTE85.94Macro F1 (%)37.2
Open Portuguese LLM - BLUEX45.48Accuracy (%)36.3
Open Portuguese LLM - ENEM52.27Accuracy (%)35.9
Open Portuguese LLM - FaQuAD NLI52.81Macro F1 (%)34.9
Swallow - Post-trained English - Average54.3Average Score (%)28.4

Interactive version: theaggregate.ai/model?slug=llama-3-1-nemotron-nano-8b-v1 · How It Works · Data refreshed daily, snapshot 2026-10-15.