Loading data...
Falcon-H1-0.5B-Base: benchmark results
Provider: TII. Released 2025-05-20. Access: Open.
Aggregate Rating 1296 ± 38, rank #8672 of 10552 rated models, from 31 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 63.4 | Exact match (strict extraction: first "#### N", else first \ | 64.8 |
| Lara Mini Base Report (base-model protocol) - MATH (4-shot) | 39.2 | Math-Verify equivalence, Minerva prompts, 5,000 problems ove | 61.1 |
| Lara Mini Base Report (base-model protocol) - MMLU-Pro (5 (CoT)-shot) | 33 | Exact match (%), English benchmark | 55.6 |
| Lara Mini Base Report (base-model protocol) - PAWS (English) (0-shot) | 65.2 | Accuracy (%), English benchmark | 51.9 |
| Lara Mini Base Report (base-model protocol) - CRUXEval-I (2-shot) | 29.4 | pass@1, direct prediction, official answer parser (%) | 42.6 |
| Lara Mini Base Report (base-model protocol) - MBPP (3-shot) | 36 | pass@1 (execution) (%) | 38.9 |
| Lara Mini Base Report (base-model protocol) - MMLU (5-shot) | 55.1 | Accuracy (%), English benchmark | 38 |
| Lara Mini Base Report (base-model protocol) - MBPP+ (3-shot) | 40.7 | pass@1; must pass MBPP's own and the EvalPlus tests (%) | 33.3 |
| Lara Mini Base Report (base-model protocol) - XNLI (English) (0-shot) | 52.3 | Accuracy (%), English benchmark | 33.3 |
| Lara Mini Base Report (base-model protocol) - Belebele (English) (0-shot) | 50.1 | Accuracy (%), English benchmark | 29.6 |
| Open Portuguese LLM - OAB Exams | 31.44 | Accuracy (%) | 28.1 |
| Lara Mini Base Report (base-model protocol) - ARC-Challenge (25-shot) | 47.1 | Accuracy normalized by answer length (%), English benchmark | 24.1 |
Interactive version: theaggregate.ai/model?slug=falcon-h1-0-5b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.