GaelEval - Linguistic Competence (Gaelic Prompt): leaderboard

GaelEval (2026) is a Scottish Gaelic benchmark from the DR-LIB project. This board is accuracy in percent on its 120-item multiple-choice test of Gaelic morphosyntax and idiom, written by a Gaelic linguist across 16 grammatical categories, answered with a Gaelic-language system prompt; higher is better.

Metric: Accuracy (%) on the 120-item Gaelic morphosyntactic MCQA with a Gaelic-language system prompt, exact string match, single call per item, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 19 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)83.3#119
2Gemini 3 Flash (Preview)79.2#152
3GPT-569.2#178
4Gemini 2.5 Flash61.7#463
5Claude Opus 4.659.2#113
6GPT-4o50#751
7Claude Haiku 4.547.5#583
8GPT-5 Mini47.5#364
9DeepSeek R145#482
10Llama 4 Maverick45#1110
11GPT-5.243.3#185
12GPT-4.142.5#505
13GPT-5 Nano36.7#906
14GPT-4o Mini34.2#1667
15GPT-OSS-120B33.3#704

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=gaeleval-linguistic-competence-gaelic-prompt · How It Works · Data refreshed daily, snapshot 2026-11-21.