Icelandic LLM - Idiom Meanings: leaderboard
The model explains in one sentence what an Icelandic idiom means, rated by an LLM judge against a reference definition as 0, 1/2 or 1.
Metric: LLM Judge Score (%). Source: huggingface.co. Saturation forecast: Around February 2027. 88 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 84.61 | #6 |
| 2 | Claude Opus 5 | 84.55 | #16 |
| 3 | Claude Opus 5.5 | 84.04 | #3 |
| 4 | Claude Opus 4.8 | 83.59 | #39 |
| 5 | Claude Fable 5.1 | 83.4 | #10 |
| 6 | GPT-6.1 Sol | 82.82 | #7 |
| 7 | Gemini 3.7 Flash | 82.06 | #24 |
| 8 | Gemini 3.1 Pro (Preview) | 81.86 | #64 |
| 9 | Gemini 4 Argon | 81.67 | #9 |
| 10 | Gemini 3.8 Flash | 81.61 | #30 |
| 11 | GPT-6 Sol | 81.55 | #19 |
| 12 | Gemini 3.5 Flash | 81.03 | #66 |
| 13 | Claude Sonnet 5 | 80.33 | #65 |
| 14 | GPT-6.1 Terra | 79.76 | #15 |
| 15 | Claude Sonnet 5.5 | 79.31 | #14 |
Interactive version: theaggregate.ai/benchmark?slug=icelandic-llm-idiom-meanings · How It Works · Data refreshed daily, snapshot 2026-11-05.