Luth-LFM2-1.2B: benchmark results
Provider: Other. Access: Open.
Unified ELO 1365 ± 31, rank #2136 of 2656 rated models, from 17 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Kurakurai French LLM - GPQA Diamond | 27.4 | Accuracy (%) | 67.1 |
| Kurakurai French LLM - IFEval | 64.09 | Accuracy (%) | 67.1 |
| Kurakurai French LLM - MATH-500 | 46.28 | Accuracy (%) | 63.4 |
| Kurakurai French LLM - MGSM | 62.56 | Accuracy (%) | 63.4 |
| Kurakurai French LLM - MultiIF | 42.15 | Accuracy (%) | 63.4 |
| Kurakurai French LLM - Global MMLU | 51.2 | Accuracy (%) | 58.5 |
| Kurakurai French LLM - HumanEval+ | 30.63 | pass@1 (%) | 56.1 |
| Kurakurai French LLM - MMLU-Pro | 26 | Accuracy (%) | 56.1 |
| Kurakurai French LLM - AIME 2025 | 0.67 | Accuracy (%) | 54.9 |
| Kurakurai French LLM - MBPP | 35.63 | pass@1 (%) | 48.8 |
| Kurakurai French LLM - AIME 2024 | 1 | Accuracy (%) | 47.6 |
| Open Portuguese LLM - FaQuAD NLI | 59.03 | Macro F1 (%) | 43.1 |
Interactive version: theaggregate.ai/model?slug=luth-lfm2-1-2b · How It Works · Data refreshed daily, snapshot 2026-09-19.