Loading data...
LFM3-1.7B-Base: benchmark results
Provider: Liquid AI. Access: Open.
Aggregate Rating 1389 ± 34, rank #6594 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - MGSM (8 (CoT)-shot) | 46.2 | Exact match on each language's native CoT answer phrase, ave | 77.8 |
| Lara Mini Base Report (base-model protocol) - MATH (4-shot) | 43.6 | Math-Verify equivalence, Minerva prompts, 5,000 problems ove | 74.1 |
| Lara Mini Base Report (base-model protocol) - PAWS-X, All Languages (0-shot) | 57.2 | Accuracy (%) averaged over all languages/variants of the ben | 74.1 |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 66.9 | Exact match (strict extraction: first "#### N", else first \ | 70.4 |
| Lara Mini Base Report (base-model protocol) - CRUXEval-I (2-shot) | 35.1 | pass@1, direct prediction, official answer parser (%) | 69.4 |
| Lara Mini Base Report (base-model protocol) - MMLU-Pro (5 (CoT)-shot) | 35.7 | Exact match (%), English benchmark | 64.8 |
| Lara Mini Base Report (base-model protocol) - INCLUDE, All Languages (5-shot) | 43.9 | Accuracy (%) averaged over all languages/variants of the ben | 63 |
| Lara Mini Base Report (base-model protocol) - Global MMLU, All Languages (5-shot) | 46.7 | Accuracy (%) averaged over all languages/variants of the ben | 61.1 |
| Lara Mini Base Report (base-model protocol) - Belebele (English) (0-shot) | 69.3 | Accuracy (%), English benchmark | 59.3 |
| Lara Mini Base Report (base-model protocol) - XCOPA, All Languages (0-shot) | 57.4 | Accuracy (%) averaged over all languages/variants of the ben | 57.4 |
| Lara Mini Base Report (base-model protocol) - PAWS (English) (0-shot) | 65.3 | Accuracy (%), English benchmark | 54.6 |
| Lara Mini Base Report (base-model protocol) - Belebele, All Languages (0-shot) | 34.4 | Accuracy (%) averaged over all languages/variants of the ben | 53.7 |
Interactive version: theaggregate.ai/model?slug=lfm3-1-7b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.