Llama 3.1 Nemotron Ultra 253B v1 — benchmark results

NVIDIA Llama 3.1 Nemotron Ultra 253B v1 model row. Provider: NVIDIA. Released 2025-04-07. Access: Open.

Unified ELO 1510 ± 32, rank #766 of 1776 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
UGI - Natural Intelligence32.63NatInt Score79.3
ZeroEval MATH-50097MATH-500 Score75.8
UGI Leaderboard36.95UGI Score57.7
ZeroEval GPQA Diamond76.01GPQA Diamond Score56.6
BenchTable50.9Total Score (%)54.5
UGI - Writing34.61Writing Score53.9
Chatbot Arena (Text)1347Elo50.3
AI Chess Leaderboard (Reasoning)637Elo44.5
FinanceArena41.9Overall Accuracy (self-reported)36.1
UGI - Willingness (W/10)4W/10 Score29.9
EQ-Bench 31139.8Elo24.7
EQ-Bench1034.5Normalized Elo (self-reported)23.7

Interactive version: theaggregate.ai/model?slug=llama-3-1-nemotron-ultra-253b-v1 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.