Ukrainian LLM - Belebele UKR Cyrl: leaderboard

The "Belebele UKR Cyrl" subtask of Ukrainian LLM. A task from the Ukrainian LLM Leaderboard, evaluating models on Ukrainian-language understanding, knowledge and reasoning.

Metric: Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 15 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 26B A4B (IT) (Reasoning)95.33#297 (Gemma 4 26B A4B (IT))
2MamayLM-Gemma-3-12B-IT-v1.089.89#584
3gemma-3-12B-pt89.56#686
4lapa-12B-pt88.44#1002
5Gemma 3 12B (IT)87.22#664
6lapa-v0.1.2-instruct86.89#672
7Qwen3-8B-Base86.11#626
8Llama 3.1 8B77.22#1151
9gemma-3-4B-pt Base71.89#1134
10Llama 3.1 8B Instruct63.78#1035
11Gemma 3 4B (IT)45.33#992

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=ukrainian-llm-belebele-ukr-cyrl · How It Works · Data refreshed daily, snapshot 2026-10-20.