EuroEval Finnish NLU - ScaLA FI — leaderboard

Metric: Linguistic acceptability Score (%). Source: euroeval.com. 372 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)62.11
2Gemini 3.1 Flash Lite (Preview)59.08
3Gemma 4 31B (IT)58.36
4Gemini 3 Flash (Preview) (Non-reasoning)54.95
5Gemini 2.5 Pro53.35
6GPT-5.4 Nano (High)51.4
7GPT-5 (Minimal)48.36
8GPT-5 (High)48.12
9Gemini 2.5 Flash (Preview 04-17)47.25
10O3 (2025-04-16)46.79
11GPT-546.59
12Qwen 3 235B A22B 2507 Instruct45.86
13Gemma 4 26B A4B (IT)45.41
14GPT-4.1 Mini45.18
15Gemini 2.5 Flash (Thinking)44.49

Interactive version: theaggregate.ai/benchmark?slug=euroeval-finnish-nlu-scala-fi · How the rankings work · Data refreshed daily, snapshot 2026-07-22.