EuroEval Finnish Summarization - Xlsum FI — leaderboard

Metric: Score (%). Source: euroeval.com. 151 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Preview) (Non-reasoning)32.86
2Gemini 3 Pro (Preview)32.77
3Gemini 3.1 Flash Lite (Preview)32.72
4Gemma 3 27B (IT)32.55
5Gemma 4 26B A4B (IT)32.22
6GPT-4.132.16
7Gemma 4 31B (IT)32.16
8Gemma 3 12B (IT)32.09
9Claude Sonnet 4.631.94
10Claude Sonnet 4.5 (Non-reasoning)31.85
11Claude Sonnet 4.5 (Thinking)31.66
12GPT-5.4 Mini (Non-reasoning)31.53
13Ministral-3-14B-Instruct-251231.36
14GPT-5.4 Mini (Medium)31.26
15GPT-5.4 Mini (High)31.14

Interactive version: theaggregate.ai/benchmark?slug=euroeval-finnish-summarization-xlsum-fi · How the rankings work · Data refreshed daily, snapshot 2026-07-22.