Llama 3.3 Nemotron Super 49B (v1) (Reasoning): benchmark results
Provider: NVIDIA. Released 2025-03-18. Access: Open.
Aggregate Rating 1517 ± 18, rank #1031 of 2201 rated models, from 55 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| NVIDIA Nemotron 49B Report - GPQA-Diamond | 66.7 | Score (%) | 100 |
| NVIDIA Nemotron 49B Report - MATH500 | 96.6 | Score (%) | 100 |
| NVIDIA Nemotron 49B v1 Card - AIME25 | 58.4 | pass@1 | 100 |
| NVIDIA Nemotron 49B v1 Card - GPQA | 66.67 | pass@1 | 100 |
| NVIDIA Nemotron 49B v1 Card - MATH500 | 96.6 | pass@1 | 100 |
| NVIDIA Nemotron 49B v1 Card - MBPP 0-shot | 91.3 | pass@1 | 100 |
| RFEval - Context Understanding | 81.7 | Contrast-conditional reasoning faithfulness (%): after a cou | 100 |
| RFEval - Paper Review | 98.47 | Contrast-conditional reasoning faithfulness (%): after a cou | 100 |
| RFEval - Mathematical Reasoning | 44.9 | Contrast-conditional reasoning faithfulness (%): after a cou | 90.9 |
| RFEval | 68.52 | Contrast-conditional reasoning faithfulness (%): after a cou | 90 |
| RFEval - Logical Reasoning | 77.13 | Contrast-conditional reasoning faithfulness (%): after a cou | 81.8 |
| NVIDIA Nemotron 49B Report - AIME25 | 60 | Score (%) | 75 |
Interactive version: theaggregate.ai/model?slug=llama-3-3-nemotron-super-49b-v1-reasoning · How It Works · Data refreshed daily, snapshot 2026-11-12.