Llama Nemotron Super 49B v1.5: benchmark results
Provider: NVIDIA. Released 2025-07-25.
Aggregate Rating 1628 ± 25, rank #767 of 10916 rated models, from 43 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA MATH-500 | 98.33 | Accuracy (%) | 88.3 |
| AA LiveCodeBench | 73.65 | Pass@1 (%) | 84.5 |
| AA MMLU-Pro | 81.38 | Accuracy (%) | 74.7 |
| AA AIME 2025 | 76.67 | Accuracy (%) | 71.4 |
| AA Omniscience - Software Engineering (SWE) - HTML | 36 | Accuracy (%) | 69.5 |
| AA Omniscience - Software Engineering (SWE) - Java | 17 | Accuracy (%) | 62.8 |
| AA Global-MMLU-Lite - Italian | 88.67 | Accuracy (%) | 62.3 |
| AA Omniscience - Software Engineering (SWE) - Go | 18 | Accuracy (%) | 56.5 |
| AA Global-MMLU-Lite - Swahili | 75.58 | Accuracy (%) | 56.4 |
| AA GPQA Diamond | 74.85 | Accuracy (%) | 56.2 |
| AA Global-MMLU-Lite - Bengali | 82.67 | Accuracy (%) | 55.9 |
| AA Global-MMLU-Lite - French | 87.08 | Accuracy (%) | 55.5 |
Interactive version: theaggregate.ai/model?slug=llama-nemotron-super-49b-v1-5 · How It Works · Data refreshed daily, snapshot 2026-11-08.