GaelEval - Linguistic Competence (English Prompt): leaderboard

GaelEval (2026) is a Scottish Gaelic benchmark from the DR-LIB project. This board is accuracy in percent on its 120-item multiple-choice test of Gaelic morphosyntax and idiom, written by a Gaelic linguist across 16 grammatical categories, answered with an English-language system prompt; higher is better.

Metric: Accuracy (%) on the 120-item Gaelic morphosyntactic MCQA with an English-language system prompt, exact string match, single call per item, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 19 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro (Preview)80#119
2Gemini 3 Flash (Preview)77.5#152
3GPT-571.7#178
4Gemini 2.5 Flash62.5#463
5Claude Opus 4.650.8#113
6GPT-4o46.7#751
7Claude Haiku 4.543.3#583
8GPT-4.142.5#505
9DeepSeek R142.5#482
10GPT-5 Mini41.7#364
11GPT-5.240#185
12Llama 4 Maverick40#1110
13GPT-4.1 Nano31.7#2056
14GPT-5 Nano30.8#906
15GPT-4o Mini30#1667

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=gaeleval-linguistic-competence-english-prompt · How It Works · Data refreshed daily, snapshot 2026-11-21.