Luth-LFM2-700M: benchmark results
Provider: Other. Access: Open.
Unified ELO 1325 ± 31, rank #2373 of 2656 rated models, from 17 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Kurakurai French LLM - IFEval | 61.83 | Accuracy (%) | 61 |
| Kurakurai French LLM - AIME 2024 | 1.33 | Accuracy (%) | 53.7 |
| Kurakurai French LLM - MATH-500 | 37.46 | Accuracy (%) | 53.7 |
| Kurakurai French LLM - MGSM | 54.12 | Accuracy (%) | 51.2 |
| Kurakurai French LLM - MultiIF | 36.42 | Accuracy (%) | 51.2 |
| Kurakurai French LLM - Global MMLU | 43.5 | Accuracy (%) | 43.9 |
| Kurakurai French LLM - AIME 2025 | 0.33 | Accuracy (%) | 42.7 |
| Open Portuguese LLM - FaQuAD NLI | 58.63 | Macro F1 (%) | 42.5 |
| Kurakurai French LLM - HumanEval+ | 22 | pass@1 (%) | 39 |
| Kurakurai French LLM - MBPP | 26.19 | pass@1 (%) | 34.1 |
| Kurakurai French LLM - MMLU-Pro | 15.6 | Accuracy (%) | 34.1 |
| Open Portuguese LLM - ASSIN2 RTE | 83.2 | Macro F1 (%) | 33.4 |
Interactive version: theaggregate.ai/model?slug=luth-lfm2-700m · How It Works · Data refreshed daily, snapshot 2026-09-19.