EuroEval Albanian Summarization - LR SUM SQ — leaderboard

Metric: Score (%). Source: euroeval.com. 154 models tracked.

Top models

#ModelScore
1Tiny Aya Global35.09
2Mistral Small 3.134.73
3Llama 3.1 8B Instruct34.7
4Claude Sonnet 4.5 (Non-reasoning)34.68
5Bielik-11B-v2.3-Instruct34.61
6Gemini 2.5 Flash Lite (Non-reasoning)34.05
7gemma-4-E2B-it33.87
8Apertus-70B-Instruct-250933.87
9GPT-4.133.78
10Gemma 4 31B (IT)33.78
11gemma-4-E4B-it33.75
12Qwen 3 14B (Non-reasoning)33.7
13Qwen 2.5 72B Instruct33.63
14Mistral Small 3.233.61
15Qwen 3 8B (Non-reasoning)33.5

Interactive version: theaggregate.ai/benchmark?slug=euroeval-albanian-summarization-lr-sum-sq · How the rankings work · Data refreshed daily, snapshot 2026-07-22.