Belebele European - Slovak: leaderboard

SpeakLeash Belebele European Leaderboard, Slovak: Belebele multiple-choice reading comprehension over FLORES passages, four options per question, scored 0-shot by log-likelihood accuracy in an lm-evaluation-harness run. 0-100, higher is better, chance 25; open models of about 4.5B-15B parameters.

Metric: Accuracy (%, 0-shot). Source: huggingface.co. Saturation forecast: Estimated already saturated. 29 models tracked.

Top models

#ModelScoreOverall rank
1cogito-v1-preview-qwen-14B89.89
2Qwen 2.5 14B Instruct88.78#654
3Gemma 3 12B (IT)88.22#672
4Gemma 2 9B (IT)87.78#795
5Qwen 3 14B87.44#542
6GaMS3-12B-Instruct85.78#706
7Qwen 3 8B84#678
8Phi-482#707
9Mistral Nemo Instruct (2407)75.33#917
10Qwen 2.5 7B74.56#895
11EuroLLM-9B-Instruct70#1047
12Gemma 2 9B67.56#924
13Apertus-8B-Instruct-250967.22#1028
14PLLuM-12B-nc-chat-25071561.11#953
15EuroLLM-9B56.89#1238

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=belebele-european-slovak · How It Works · Data refreshed daily, snapshot 2026-11-05.