EuroEval Finnish NLU - Turku NER FI — leaderboard

Metric: Named entity recognition Score (%). Source: euroeval.com. 374 models tracked.

Top models

#ModelScore
1GPT-5.4 Mini (High)78.33
2Gemma 4 31B (IT)77.03
3GPT-5 (High)76.97
4GPT-576.54
5GPT-5.4 Mini (Medium)75
6Llama 3.1 70B73.64
7Claude Sonnet 4.5 (Thinking)72.92
8Gemma 4 26B A4B (IT)72.83
9Llama 3 70B72.14
10OLMo 3.1 32B (Thinking)71.69
11Llama 3.1 405B71.28
12Mistral Small 3.170.37
13Qwen 3 30B A3B70.09
14Claude Sonnet 4.669.95
15O3 (2025-04-16)69.71

Interactive version: theaggregate.ai/benchmark?slug=euroeval-finnish-nlu-turku-ner-fi · How the rankings work · Data refreshed daily, snapshot 2026-07-22.