Loading data...
LFM2.5-8B-A1B-Base: benchmark results
Provider: Liquid AI. Access: Open.
Aggregate Rating 1399 ± 36, rank #6243 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - ARC-Challenge (25-shot) | 64.9 | Accuracy normalized by answer length (%), English benchmark | 94.4 |
| Lara Mini Base Report (base-model protocol) - MMLU-Pro (5 (CoT)-shot) | 39.8 | Exact match (%), English benchmark | 87 |
| Lara Mini Base Report (base-model protocol) - MATH (4-shot) | 45.8 | Math-Verify equivalence, Minerva prompts, 5,000 problems ove | 79.6 |
| Lara Mini Base Report (base-model protocol) - Global MMLU, All Languages (5-shot) | 50.3 | Accuracy (%) averaged over all languages/variants of the ben | 77.8 |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 67.6 | Exact match (strict extraction: first "#### N", else first \ | 75.9 |
| Lara Mini Base Report (base-model protocol) - COPA (0-shot) | 85.4 | Accuracy (%), English benchmark | 73.1 |
| Lara Mini Base Report (base-model protocol) - MGSM (8 (CoT)-shot) | 43.3 | Exact match on each language's native CoT answer phrase, ave | 70.4 |
| Lara Mini Base Report (base-model protocol) - MMLU (5-shot) | 63.2 | Accuracy (%), English benchmark | 70.4 |
| Lara Mini Base Report (base-model protocol) - XCOPA, All Languages (0-shot) | 58.6 | Accuracy (%) averaged over all languages/variants of the ben | 69.4 |
| Lara Mini Base Report (base-model protocol) - Global PIQA (non-parallel), All Languages (0-shot) | 56.9 | Accuracy (%) averaged over all languages/variants of the ben | 68.5 |
| Lara Mini Base Report (base-model protocol) - Global PIQA (parallel), All Languages (0-shot) | 25.1 | Accuracy (%) averaged over all languages/variants of the ben | 66.7 |
| Lara Mini Base Report (base-model protocol) - INCLUDE, All Languages (5-shot) | 44.5 | Accuracy (%) averaged over all languages/variants of the ben | 66.7 |
Interactive version: theaggregate.ai/model?slug=lfm2-5-8b-a1b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.