Belebele European - Russian: leaderboard
Metric: Accuracy (%, 0-shot). Source: huggingface.co. 29 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 2.5 14B Instruct | 90.44 |
| 2 | Qwen 3 14B | 88.89 |
| 3 | Gemma 3 12B (IT) | 88.67 |
| 4 | Gemma 2 9B (IT) | 88.11 |
| 5 | Phi-4 | 88.11 |
| 6 | GaMS3-12B-Instruct | 87 |
| 7 | Qwen 3 8B | 86.89 |
| 8 | Qwen 2.5 7B | 82.56 |
| 9 | Mistral Nemo Instruct (2407) | 81.22 |
| 10 | Apertus-8B-Instruct-2509 | 74.33 |
| 11 | Gemma 2 9B | 71.56 |
| 12 | PLLuM-12B-nc-chat-250715 | 70.78 |
| 13 | Mistral 7B Instruct (v0.2) | 58.11 |
| 14 | Mistral-7B-v0.2 | 49.89 |
| 15 | Bielik-11B-v2 | 49.78 |
Interactive version: theaggregate.ai/benchmark?slug=belebele-european-russian · How It Works · Data refreshed daily, snapshot 2026-09-19.