EuroEval Finnish NLU - Scandisent FI: leaderboard

The "Scandisent FI" subtask of EuroEval Finnish NLU. Finnish-language EuroEval natural-language-understanding suite, separating NLU task performance from the broader all-task EuroEval aggregate.

Metric: Matthews correlation coefficient (%). Source: euroeval.com. Saturation forecast: Estimated already saturated. 377 models tracked.

Top models

#ModelScoreOverall rank
1gemma-3-27B-pt93.78#502
2Llama 2 70B Base93.51#1025
3Llama 3.1 405B93.31#466
4Gemma 3n E4B93.19#878
5Gemma 2 27B93.12#806
6gemma-3-12B-pt92.87#686
7Apertus-70B-Instruct-250992.75#820
8Llama 3.1 Nemotron 70B Instruct92.66#554
9Llama 3.1 70B92.64#592
10gemma-3-4B-pt Base92.64#1134
11Llama 3.1 70B Instruct92.62#561
12Llama 3.1 405B Instruct FP892.59#389
13Llama 4 Scout Instruct92.52#539
14Qwen 2.5 72B Instruct92.47#454
15Claude 3.5 Haiku (20241022)92.47#588

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=euroeval-finnish-nlu-scandisent-fi · How It Works · Data refreshed daily, snapshot 2026-10-20.