Loading data...
granite-4.0-1B-base: benchmark results
Provider: IBM. Access: Open.
Aggregate Rating 1361 ± 34, rank #7383 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - CRUXEval-I (2-shot) | 39.6 | pass@1, direct prediction, official answer parser (%) | 86.1 |
| Lara Mini Base Report (base-model protocol) - CRUXEval-O (2-shot) | 36.1 | pass@1, direct prediction, official answer parser (%) | 70.4 |
| Lara Mini Base Report (base-model protocol) - MBPP (3-shot) | 46.4 | pass@1 (execution) (%) | 61.1 |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 59.4 | Exact match (strict extraction: first "#### N", else first \ | 59.3 |
| Lara Mini Base Report (base-model protocol) - MATH (4-shot) | 35.5 | Math-Verify equivalence, Minerva prompts, 5,000 problems ove | 55.6 |
| Lara Mini Base Report (base-model protocol) - MBPP+ (3-shot) | 49.7 | pass@1; must pass MBPP's own and the EvalPlus tests (%) | 55.6 |
| Lara Mini Base Report (base-model protocol) - MGSM (8 (CoT)-shot) | 35 | Exact match on each language's native CoT answer phrase, ave | 51.9 |
| Lara Mini Base Report (base-model protocol) - WinoGrande (5-shot) | 67.6 | Accuracy (%), English benchmark | 50.9 |
| Lara Mini Base Report (base-model protocol) - COPA (0-shot) | 82.6 | Accuracy (%), English benchmark | 48.1 |
| Lara Mini Base Report (base-model protocol) - HellaSwag (10-shot) | 70.2 | Accuracy normalized by answer length (%), English benchmark | 48.1 |
| Lara Mini Base Report (base-model protocol) - MMLU (5-shot) | 57.2 | Accuracy (%), English benchmark | 48.1 |
| Lara Mini Base Report (base-model protocol) - Belebele, All Languages (0-shot) | 32.2 | Accuracy (%) averaged over all languages/variants of the ben | 47.2 |
Interactive version: theaggregate.ai/model?slug=granite-4-0-1b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.