Kaggle MultiLoKo - Marathi Task v6: leaderboard
Meta MultiLoKo native Kaggle revisions: 30 languages at task v6 and German at v2, with 250 items per language where evaluated. Average v2 requires numeric results for all 31 tasks. Language boards retain their reported rows. These revisions are distinct from the historical EM tasks. Urdu retains the existing reviewed scoring hold.
Metric: Exact Match (%). Source: www.kaggle.com. Saturation forecast: Around 2029. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 50.4 | #60 |
| 2 | GPT-6 Astra | 48.8 | #6 |
| 3 | Claude Opus 5.5 | 44.8 | #5 |
| 4 | GPT-6.1 Sol | 44.8 | #7 |
| 5 | Gemini 3.8 Flash | 44 | #23 |
| 6 | Gemini 4 Argon | 42.4 | #8 |
| 7 | Claude Sonnet 5.5 | 37.6 | #11 |
| 8 | Grok 4.7 | 36.4 | #26 |
| 9 | Claude Opus 4.8 | 34 | #37 |
| 10 | GPT-6 Luna | 34 | #61 |
| 11 | Claude Sonnet 5 | 30.4 | #62 |
| 12 | GLM-5 | 30 | #146 |
| 13 | Qwen 3.8 Max | 27.6 | #32 |
| 14 | Kimi K3 | 26.8 | #33 |
| 15 | Gemma 4 31B | 24.4 | #203 |
No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=kaggle-multiloko-marathi-task-v6 · How It Works · Data refreshed daily, snapshot 2026-10-25.