EuroEval Slovene NLU - SSJ500K NER — leaderboard

Metric: Named entity recognition Score (%). Source: euroeval.com. 204 models tracked.

Top models

#ModelScore
1GPT-5.4 Mini (Medium)83.51
2GPT-5.4 Mini (High)80.44
3Claude Sonnet 4.5 (Thinking)76.38
4GPT-5 Nano75.39
5GPT-575.31
6Claude Sonnet 4.5 (Non-reasoning)74.26
7Qwen 3 4B 2507 (Thinking)74.2
8Gemma 4 31B (IT)73.49
9Gemma 4 26B A4B (IT)72.7
10Gemini 3 Flash (Preview) (Non-reasoning)71.77
11OLMo 3.1 32B (Thinking)71.59
12Gemini 2.5 Flash (Thinking)71.5
13Gemini 2.5 Flash (Non-reasoning)71.18
14Grok 4.1 Fast (Reasoning)71.13
15Gemini 3 Pro (Preview)70.92

Interactive version: theaggregate.ai/benchmark?slug=euroeval-slovene-nlu-ssj500k-ner · How the rankings work · Data refreshed daily, snapshot 2026-07-22.