Loading data...
Nemotron-Flash-1B: benchmark results
Provider: NVIDIA. Access: Open.
Aggregate Rating 1296 ± 37, rank #8677 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - MATH (4-shot) | 44.9 | Math-Verify equivalence, Minerva prompts, 5,000 problems ove | 75.9 |
| Lara Mini Base Report (base-model protocol) - MBPP+ (3-shot) | 45.2 | pass@1; must pass MBPP's own and the EvalPlus tests (%) | 42.6 |
| Lara Mini Base Report (base-model protocol) - MMLU-Pro (5 (CoT)-shot) | 25 | Exact match (%), English benchmark | 40.7 |
| Lara Mini Base Report (base-model protocol) - MGSM (8 (CoT)-shot) | 22 | Exact match on each language's native CoT answer phrase, ave | 35.2 |
| Lara Mini Base Report (base-model protocol) - MBPP (3-shot) | 34.8 | pass@1 (execution) (%) | 33.3 |
| Lara Mini Base Report (base-model protocol) - PIQA (0-shot) | 75.4 | Accuracy normalized by answer length (%), English benchmark | 33.3 |
| Lara Mini Base Report (base-model protocol) - COPA (0-shot) | 79.8 | Accuracy (%), English benchmark | 32.4 |
| Lara Mini Base Report (base-model protocol) - PAWS (English) (0-shot) | 60.2 | Accuracy (%), English benchmark | 25.9 |
| Lara Mini Base Report (base-model protocol) - PAWS-X, All Languages (0-shot) | 52.2 | Accuracy (%) averaged over all languages/variants of the ben | 24.1 |
| Lara Mini Base Report (base-model protocol) - XNLI (English) (0-shot) | 51.2 | Accuracy (%), English benchmark | 23.1 |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 32.2 | Exact match (strict extraction: first "#### N", else first \ | 22.2 |
| Lara Mini Base Report (base-model protocol) - ARC-Challenge (25-shot) | 46 | Accuracy normalized by answer length (%), English benchmark | 20.4 |
Interactive version: theaggregate.ai/model?slug=nemotron-flash-1b · How It Works · Data refreshed daily, snapshot 2026-11-16.