Kaggle MultiLoKo - Arabic Task v6: leaderboard
Meta MultiLoKo native Kaggle revisions: 30 languages at task v6 and German at v2, with 250 items per language where evaluated. Average v2 requires numeric results for all 31 tasks. Language boards retain their reported rows. These revisions are distinct from the historical EM tasks. Urdu retains the existing reviewed scoring hold.
Metric: Exact Match (%). Source: www.kaggle.com. Saturation forecast: Around 2030. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 51.6 | #60 |
| 2 | Gemini 3.8 Flash | 46 | #23 |
| 3 | GPT-6 Astra | 43.2 | #6 |
| 4 | GPT-6.1 Sol | 41.6 | #7 |
| 5 | Gemini 4 Argon | 38.4 | #8 |
| 6 | Qwen 3.8 Max | 36.4 | #32 |
| 7 | Grok 4.7 | 30 | #26 |
| 8 | GPT-6 Luna | 28.4 | #61 |
| 9 | GLM-5 | 24.4 | #146 |
| 10 | Claude Sonnet 5.5 | 22.8 | #11 |
| 11 | Gemma 4 31B | 20 | #203 |
| 12 | Claude Opus 5.5 | 19.6 | #5 |
| 13 | Kimi K3 | 18 | #33 |
| 14 | Claude Opus 4.8 | 11.2 | #37 |
| 15 | GLM-5.3 Flash | 9.6 | #73 |
No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=kaggle-multiloko-arabic-task-v6 · How It Works · Data refreshed daily, snapshot 2026-10-25.