Belebele European - Lithuanian: leaderboard
Metric: Accuracy (%, 0-shot). Source: huggingface.co. 29 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 3 12B (IT) | 86.67 |
| 2 | Qwen 3 14B | 86.33 |
| 3 | Gemma 2 9B (IT) | 86 |
| 4 | GaMS3-12B-Instruct | 83.33 |
| 5 | Qwen 2.5 14B Instruct | 80.22 |
| 6 | Qwen 3 8B | 80 |
| 7 | Phi-4 | 76.67 |
| 8 | Mistral Nemo Instruct (2407) | 68.44 |
| 9 | Gemma 2 9B | 66.11 |
| 10 | Apertus-8B-Instruct-2509 | 66 |
| 11 | Qwen 2.5 7B | 63 |
| 12 | PLLuM-12B-nc-chat-250715 | 54 |
| 13 | Mistral 7B Instruct (v0.2) | 37.78 |
| 14 | Bielik-11B-v2 | 34.67 |
| 15 | Mistral-7B-v0.2 | 34.11 |
Interactive version: theaggregate.ai/benchmark?slug=belebele-european-lithuanian · How It Works · Data refreshed daily, snapshot 2026-09-19.