EuroEval Polish NLU - Polemo2: leaderboard

The "Polemo2" subtask of EuroEval Polish NLU. Polish-language EuroEval natural-language-understanding suite, separating NLU task performance from the broader all-task EuroEval aggregate.

Metric: Matthews correlation coefficient (%). Source: euroeval.com. Saturation forecast: Estimated already saturated. 234 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.1 70B97.77#592
2Gemma 4 31B (IT)96.92#176
3GLM-4.7 Flash95.48#509
4Bielik-11B-v2.3-Instruct95.27#693
5Mistral Small 3.295.17#605
6Voxtral-Small-24B-250795.11#581
7Mistral Small 3.194.91#610
8Llama 3.1 8B94.7#1151
9gemma-3-27B-pt94.61#502
10Magistral Small 1.294.56#570
11Qwen 3.5 35B A3B Base93.43#310
12Llama 3.3 70B Instruct93.31#534
13Ministral-3-14B-Instruct-251293.21#615
14Qwen 3 8B (Non-reasoning)92.97#674 (Qwen 3 8B)
15gemma-3-4B-pt Base92.84#1134

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=euroeval-polish-nlu-polemo2 · How It Works · Data refreshed daily, snapshot 2026-10-20.