Kaggle MultiLoKo - Japanese Task v6: leaderboard
Meta MultiLoKo native Kaggle revisions: 30 languages at task v6 and German at v2, with 250 items per language where evaluated. Average v2 requires numeric results for all 31 tasks. Language boards retain their reported rows. These revisions are distinct from the historical EM tasks. Urdu retains the existing reviewed scoring hold.
Metric: Exact Match (%). Source: www.kaggle.com. Saturation forecast: Around August 2027. 15 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 63.6 | #60 |
| 2 | GPT-6.1 Sol | 62.8 | #7 |
| 3 | GPT-6 Astra | 62 | #6 |
| 4 | Gemini 3.8 Flash | 55.2 | #23 |
| 5 | Gemini 4 Argon | 52.8 | #8 |
| 6 | GPT-6 Luna | 50.4 | #61 |
| 7 | Claude Opus 5.5 | 43.6 | #5 |
| 8 | Qwen 3.8 Max | 36 | #32 |
| 9 | Grok 4.7 | 32 | #26 |
| 10 | Claude Sonnet 5.5 | 28.8 | #11 |
| 11 | Claude Sonnet 5 | 20.8 | #62 |
| 12 | GLM-5 | 19.6 | #146 |
| 13 | Claude Opus 4.8 | 15.2 | #37 |
| 14 | GLM-5.3 Flash | 13.6 | #73 |
| 15 | Gemma 4 31B | 12.8 | #203 |
No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=kaggle-multiloko-japanese-task-v6 · How It Works · Data refreshed daily, snapshot 2026-10-25.