Mizan - MSA: leaderboard

The Modern Standard Arabic track of Mizan, which most of the field saturates at 100 on the frozen pilot board. Auto-scored; higher is better. Source: arxiv.org/abs/2609.13980.

Metric: Score (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 27 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o100#357
2Gemini 2.5 Pro100#159
3GPT-5100#105
4Gemini 2.5 Flash100#255
5Gemma 4 31B (IT)100#178
6Claude Opus 5100#16
7GPT-6 Astra100#6
8Claude Sonnet 5100#65
9Claude Fable 5100#20
10Claude Sonnet 4.597.5#148
11GPT-OSS-120B97.5#346
12Claude Haiku 4.597.5#287
13Gemma 3 27B (IT)95#528
14Llama 3.3 70B Instruct95#541
15DeepSeek V3.295#210

No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #9 Gemini 4 Argon.

Interactive version: theaggregate.ai/benchmark?slug=mizan-msa · How It Works · Data refreshed daily, snapshot 2026-11-05.