Llama 3.1 Nemotron Ultra 253B v1: benchmark results
NVIDIA's Llama-3.1-Nemotron-Ultra-253B, a reasoning-tuned, NAS-pruned refinement of Llama 3.1 405B (April 2025). Provider: NVIDIA. Released 2025-04-07. Access: Open.
Unified ELO 1523 ± 1, rank #583 of 1392 rated models, from 29 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| UGI - Natural Intelligence | 32.63 | NatInt Score | 78.5 |
| ZeroEval MATH-500 | 97 | MATH-500 Score | 75.8 |
| UGI Leaderboard | 36.95 | UGI Score | 57.3 |
| Chatbot Arena (Text - Math) | 1381 | Arena Score | 56 |
| ZeroEval GPQA Diamond | 76.01 | GPQA Diamond Score | 55 |
| BenchTable | 50.9 | Total Score (%) | 54.5 |
| UGI - Writing | 34.61 | Writing Score | 53.3 |
| Chatbot Arena (Text - Creative Writing) | 1331 | Arena Score | 53.1 |
| Chatbot Arena (Text - Instruction Following) | 1351 | Arena Score | 52.8 |
| Chatbot Arena (Text - Hard Prompts) | 1375 | Arena Score | 52.1 |
| Chatbot Arena (Text - English) | 1376 | Arena Score | 51.5 |
| Chatbot Arena (Text - Multi-Turn) | 1343 | Arena Score | 48.4 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-nemotron-ultra-253b-v1 · How It Works · Data refreshed daily, snapshot 2026-09-05.