HELM Arabic - Arabic Mmlu - History (Middle School): leaderboard

HELM Arabic (release v2.2.0) ArabicMMLU History (Middle School): native Arabic multiple-choice questions from ArabicMMLU, which draws on school, university and professional exams across Arabic-speaking countries; 203 questions, exact match. Percent correct, 0-100, higher is better.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 41 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 (2026-03-05)82.27#63
2Claude Opus 4.781.77#51
3Claude Sonnet 4.680.79#94
4GPT-4.1 (2025-04-14)80.79#257
5GPT-5.1 (2025-11-13)80.79#107
6Llama 4 Maverick Instruct FP878.82#424
7Gemini 2.5 Flash (Non-reasoning)78.82#255 (Gemini 2.5 Flash)
8Qwen 3.5 397B A17B77.83#154
9Mistral Large 377.34#410
10GPT-5.4 Mini (2026-03-17)76.85#180
11Qwen 2.5 72B Instruct76.35#469
12Mistral Large 2 (Nov) Instruct (2411)75.86#480
13Gemini 2.5 Flash Lite (Non-reasoning)75.86#432 (Gemini 2.5 Flash Lite)
14AceGPT-v2-70B-Chat75.86#421
15Gemma 4 31B (IT)75.37#178

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-arabic-mmlu-history-middle-school · How It Works · Data refreshed daily, snapshot 2026-11-05.