LFM3-1.7B-Base: benchmark results

Provider: Liquid AI. Access: Open.

Aggregate Rating 1389 ± 34, rank #6594 of 10552 rated models, from 26 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Lara Mini Base Report (base-model protocol) - MGSM (8 (CoT)-shot)46.2Exact match on each language's native CoT answer phrase, ave77.8
Lara Mini Base Report (base-model protocol) - MATH (4-shot)43.6Math-Verify equivalence, Minerva prompts, 5,000 problems ove74.1
Lara Mini Base Report (base-model protocol) - PAWS-X, All Languages (0-shot)57.2Accuracy (%) averaged over all languages/variants of the ben74.1
Lara Mini Base Report (base-model protocol) - GSM8K (5-shot)66.9Exact match (strict extraction: first "#### N", else first \70.4
Lara Mini Base Report (base-model protocol) - CRUXEval-I (2-shot)35.1pass@1, direct prediction, official answer parser (%)69.4
Lara Mini Base Report (base-model protocol) - MMLU-Pro (5 (CoT)-shot)35.7Exact match (%), English benchmark64.8
Lara Mini Base Report (base-model protocol) - INCLUDE, All Languages (5-shot)43.9Accuracy (%) averaged over all languages/variants of the ben63
Lara Mini Base Report (base-model protocol) - Global MMLU, All Languages (5-shot)46.7Accuracy (%) averaged over all languages/variants of the ben61.1
Lara Mini Base Report (base-model protocol) - Belebele (English) (0-shot)69.3Accuracy (%), English benchmark59.3
Lara Mini Base Report (base-model protocol) - XCOPA, All Languages (0-shot)57.4Accuracy (%) averaged over all languages/variants of the ben57.4
Lara Mini Base Report (base-model protocol) - PAWS (English) (0-shot)65.3Accuracy (%), English benchmark54.6
Lara Mini Base Report (base-model protocol) - Belebele, All Languages (0-shot)34.4Accuracy (%) averaged over all languages/variants of the ben53.7

Interactive version: theaggregate.ai/model?slug=lfm3-1-7b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.