Belebele European - Ukrainian: leaderboard
Metric: Accuracy (%, 0-shot). Source: huggingface.co. 29 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 3 12B (IT) | 88.78 |
| 2 | Gemma 2 9B (IT) | 87.78 |
| 3 | Qwen 2.5 14B Instruct | 87.78 |
| 4 | Qwen 3 14B | 87.67 |
| 5 | Phi-4 | 85.56 |
| 6 | Qwen 3 8B | 84.89 |
| 7 | GaMS3-12B-Instruct | 84.67 |
| 8 | Qwen 2.5 7B | 78.67 |
| 9 | Mistral Nemo Instruct (2407) | 73.44 |
| 10 | Gemma 2 9B | 71.22 |
| 11 | Apertus-8B-Instruct-2509 | 69 |
| 12 | PLLuM-12B-nc-chat-250715 | 64.33 |
| 13 | Mistral 7B Instruct (v0.2) | 56.22 |
| 14 | Bielik-11B-v2 | 48.78 |
| 15 | Mistral-7B-v0.2 | 45.44 |
Interactive version: theaggregate.ai/benchmark?slug=belebele-european-ukrainian · How It Works · Data refreshed daily, snapshot 2026-09-19.