Llama 3.1 Nemotron Ultra 253B v1 (Reasoning) — benchmark results
Llama 3.1 Nemotron Ultra 253B v1 evaluated with reasoning enabled. Provider: NVIDIA. Released 2025-04-07. Access: Open.
Unified ELO 1581 ± 35, rank #529 of 1776 rated models, from 37 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA MMLU-Pro | 82.46 | Accuracy (%) | 80.8 |
| AA MATH-500 | 95.2 | Accuracy (%) | 80.7 |
| AA LiveCodeBench | 64.13 | Pass@1 (%) | 70.5 |
| AA Omniscience - Software Engineering (SWE) - HTML | 40 | Accuracy (%) | 67.5 |
| AA Omniscience - Humanities & Social Sciences | 22.6 | Accuracy (%) | 61.4 |
| AA Omniscience - Software Engineering (SWE) - Dart | 24 | Accuracy (%) | 60.7 |
| AA AIME 2025 | 63.67 | Accuracy (%) | 59.8 |
| AA GPQA Diamond | 72.83 | Accuracy (%) | 58 |
| AA Omniscience - Software Engineering (SWE) - Julia | 16 | Accuracy (%) | 57.8 |
| AA Omniscience - Law | 12 | Accuracy (%) | 56.1 |
| AA Humanity's Last Exam | 8.08 | Accuracy (%) | 55.3 |
| AA Omniscience - Science, Engineering & Mathematics | 26.8 | Accuracy (%) | 54.2 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-nemotron-ultra-253b-v1-reasoning · How the rankings work · Data refreshed daily, snapshot 2026-07-22.