EuroEval Slovene NLU - SSJ500K NER: leaderboard

Metric: Named entity recognition Score (%). Source: euroeval.com. 204 models tracked.

Top models

#ModelScore
1GPT-5.4 Mini (Medium)83.51
2GPT-5.4 Mini (High)80.44
3Claude Sonnet 4.5 (Thinking)76.38
4GPT-5 Nano75.39
5GPT-575.31
6Claude Sonnet 4.5 (Non-reasoning)74.26
7Qwen 3 4B 2507 (Thinking)74.2
8Gemma 4 31B (IT)73.49
9Gemma 4 26B A4B (IT)72.7
10OLMo 3.1 32B (Thinking)71.59
11Gemini 2.5 Flash (Thinking)71.5
12Grok 4.1 Fast (Reasoning)71.13
13Gemini 3 Pro (Preview)70.92
14Gemini 3.1 Flash Lite (Preview)70.24
15Claude Sonnet 4.669.54

Interactive version: theaggregate.ai/benchmark?slug=euroeval-slovene-nlu-ssj500k-ner · How It Works · Data refreshed daily, snapshot 2026-09-05.