Llama 3.1 Nemotron 70B Instruct — benchmark results
NVIDIA's RLHF-tuned Llama 3.1 70B (HelpSteer2-Preference + REINFORCE), topping Arena Hard and AlpacaEval 2 at release (October 2024). Provider: NVIDIA. Released 2024-10-15. Access: Open.
Unified ELO 1533 ± 13, rank #671 of 1776 rated models, from 194 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Portuguese | 68.25 | Average Score (%) | 97.7 |
| Open Japanese LLM - MMLU EN Exact Match | 81.23 | Score (%) | 97.6 |
| Open Japanese LLM - Jsick Exact Match | 86.62 | Score (%) | 97.1 |
| Open CoT - LSAT Logical Reasoning | 21.96 | CoT Gain (%) | 96.9 |
| Open PL LLM - Generative | 69.13 | Average Generative Score (%) | 96.9 |
| StickToYourRole | 80.66 | Cardinal Score | 96.8 |
| EuroEval Finnish NLU - Scandisent FI | 92.66 | Sentiment classification Score (%) | 94.1 |
| Open Japanese LLM - Wiki Coreference SET F1 | 9.84 | Score (%) | 94 |
| EuroEval Spanish NLU - Sentiment Headlines ES | 51.12 | Sentiment classification Score (%) | 93.9 |
| EuroEval Danish Knowledge | 91.41 | Knowledge Average Score (%) | 92.8 |
| Open CoT - LSAT Analytical Reasoning | 8.7 | CoT Gain (%) | 92.4 |
| Open LLM Leaderboard - MATH Level 5 | 42.67 | Score | 92 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-nemotron-70b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.