Ukrainian LLM - Global MMLU Full UK Virology: leaderboard

The "Global MMLU Full UK Virology" subtask of Ukrainian LLM. A task from the Ukrainian LLM Leaderboard, evaluating models on Ukrainian-language understanding, knowledge and reasoning.

Metric: Score (%). Source: huggingface.co. Saturation forecast: Around January 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1MamayLM-Gemma-3-12B-IT-v1.056.63#584
2gemma-3-12B-pt52.41#686
3lapa-12B-pt51.81#1002
4Gemma 3 12B (IT)51.2#664
5lapa-v0.1.2-instruct49.4#672
6Qwen3-8B-Base46.39#626
7Llama 3.1 8B45.18#1151
8Llama 3.1 8B Instruct43.98#1035
9gemma-3-4B-pt Base39.76#1134
10Gemma 3 4B (IT)27.11#992

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=ukrainian-llm-global-mmlu-full-uk-virology · How It Works · Data refreshed daily, snapshot 2026-10-20.