Kaggle MultiLoKo - Cantonese Task v6: leaderboard
Meta MultiLoKo native Kaggle revisions: 30 languages at task v6 and German at v2, with 250 items per language where evaluated. Average v2 requires numeric results for all 31 tasks. Language boards retain their reported rows. These revisions are distinct from the historical EM tasks. Urdu retains the existing reviewed scoring hold.
Metric: Exact Match (%). Source: www.kaggle.com. Saturation forecast: Not forecast. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 51.2 | #60 |
| 2 | Gemini 3.8 Flash | 50.8 | #23 |
| 3 | GPT-6.1 Sol | 44 | #7 |
| 4 | Gemini 4 Argon | 41.2 | #8 |
| 5 | GPT-6 Astra | 39.6 | #6 |
| 6 | Kimi K3 | 36 | #33 |
| 7 | Qwen 3.8 Max | 34.8 | #32 |
| 8 | GLM-5 | 32 | #146 |
| 9 | Grok 4.7 | 29.2 | #26 |
| 10 | GLM-5.3 Flash | 28 | #73 |
| 11 | GPT-6 Luna | 25.2 | #61 |
| 12 | Claude Opus 4.8 | 17.2 | #37 |
| 13 | Claude Sonnet 5 | 17.2 | #62 |
| 14 | Claude Sonnet 5.5 | 14.8 | #11 |
| 15 | Gemma 4 31B | 12.8 | #203 |
No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=kaggle-multiloko-cantonese-task-v6 · How It Works · Data refreshed daily, snapshot 2026-10-25.