Icelandic LLM - WikiQA: leaderboard

Open-ended factual questions on Icelandic topics sourced from Wikipedia. The model answers in Icelandic and an LLM judge grades each answer against a reference as poor, fair or excellent (0, 1/2 or 1).

Metric: LLM Judge Score (%). Source: huggingface.co. Saturation forecast: Around February 2027. 88 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.574.32#3
2Claude Fable 5.173.95#10
3Gemini 4 Argon71.26#9
4Claude Opus 569.08#16
5Gemini 3.1 Pro (Preview)68.92#64
6GPT-6 Astra66.71#6
7Gemini 3.7 Flash66.58#24
8Gemini 3.8 Flash66.55#30
9Gemini 3.5 Flash66.37#66
10GPT-6.1 Sol65.92#7
11GPT-5.6 Sol64.5#22
12Claude Opus 4.862.74#39
13Claude Sonnet 5.559.79#14
14GPT-6 Sol58.95#19
15Gemini 2.5 Pro56.18#159

Interactive version: theaggregate.ai/benchmark?slug=icelandic-llm-wikiqa · How It Works · Data refreshed daily, snapshot 2026-11-05.