NVIDIA Nemotron 49B v1 Card - MATH500: leaderboard

MATH500: 500 competition mathematics problems, pass@1 with reasoning on and off, using the card's boxed-answer prompt template. From NVIDIA's own Llama-3.3-Nemotron-Super-49B-v1 model card, which states a 32k sequence length with benchmarks run up to 16 times and averaged, and recommends temperature 0.6 with top-p 0.95 for reasoning on and greedy decoding for reasoning off.

Metric: pass@1. Source: huggingface.co. Saturation forecast: Around February 2027. 2 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.3 Nemotron Super 49B (v1) (Reasoning)96.6#1336 (Llama 3.3 Nemotron Super 49B (v1))
2Llama 3.3 Nemotron Super 49B (v1) (Non-reasoning)74#1336 (Llama 3.3 Nemotron Super 49B (v1))

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=nvidia-nemotron-49b-v1-card-math500 · How It Works · Data refreshed daily, snapshot 2026-11-12.