Kurakurai French LLM - AIME 2024: leaderboard
Evaluates small French-language models on the Kurakurai French LLM leaderboard, a static board of French translations and French subsets of standard benchmarks, filtered by size class up to about 4B parameters. Scores are percentages averaged over ten sampling seeds, decoded at temperature 0.6, top_p 0.95, top_k 20, with thinking disabled and 16k context. This series is AIME 2024 competition mathematics. These are French scores, comparable to each other but not to published English numbers for the same models. This series reports Kurakurai French LLM - AIME 2024 using Accuracy (%).
Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around February 2027. 42 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.5 4B | 58.33 | #514 |
| 2 | Qwen 3 4B 2507 Instruct | 53.33 | #768 |
| 3 | Gemma 4 E2B (IT) | 31.67 | #779 |
| 4 | LFM2 2.6B | 14 | #1313 |
| 5 | Qwen 3.5 2B | 11.67 | #1114 |
| 6 | SmolLM3-3B | 8.67 | #1239 |
| 7 | Gemma 3 4B (IT) | 6.33 | #997 |
| 8 | Qwen 3 1.7B | 5.33 | #1175 |
| 9 | LFM2.5-1.2B Instruct | 4.33 | #1451 |
| 10 | Qwen 3 0.6B | 2.67 | #1448 |
| 11 | granite-4.0-h-micro | 2.33 | #1078 |
| 12 | Phi-4 Mini Instruct | 2 | #1232 |
| 13 | Luth-0.6B-Instruct | 2 | #1402 |
| 14 | Granite 4.1 3B | 1.67 | #899 |
| 15 | Llama 3.2 3B Instruct | 1 | #1327 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=kurakurai-french-llm-aime-2024 · How It Works · Data refreshed daily, snapshot 2026-11-05.