Kurakurai French LLM - MBPP: leaderboard
Metric: pass@1 (%). Source: huggingface.co. 42 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3 4B 2507 Instruct | 76.03 |
| 2 | Gemma 4 E2B (IT) | 68.68 |
| 3 | Granite 4.1 3B | 68.07 |
| 4 | Qwen 3.5 4B | 67.75 |
| 5 | granite-4.0-h-micro | 66.32 |
| 6 | Gemma 3 4B (IT) | 62.04 |
| 7 | Qwen 3 1.7B | 57.33 |
| 8 | SmolLM3-3B | 56.14 |
| 9 | LFM2 2.6B | 54.42 |
| 10 | LFM2.5-1.2B Instruct | 48.65 |
| 11 | Llama 3.2 3B Instruct | 44.26 |
| 12 | Gemma 3 1B (IT) | 43.86 |
| 13 | Qwen 3.5 2B | 42.12 |
| 14 | Phi-4 Mini Instruct | 39.18 |
| 15 | Qwen 3 0.6B | 37.41 |
Interactive version: theaggregate.ai/benchmark?slug=kurakurai-french-llm-mbpp · How It Works · Data refreshed daily, snapshot 2026-09-19.