HELM Arabic - Arabic Mmlu - History (Primary School): leaderboard

HELM Arabic (release v2.2.0) ArabicMMLU History (Primary School): native Arabic multiple-choice questions from ArabicMMLU, which draws on school, university and professional exams across Arabic-speaking countries; 102 questions, exact match. Percent correct, 0-100, higher is better.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Around February 2027. 41 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.786.27#51
2GPT-5.4 (2026-03-05)85.29#63
3Claude Sonnet 4.683.33#94
4Llama 4 Maverick Instruct FP882.35#424
5Gemini 2.5 Flash (Non-reasoning)82.35#255 (Gemini 2.5 Flash)
6Gemma 4 31B (IT)81.37#178
7GPT-5.1 (2025-11-13)81.37#107
8Qwen 3.5 397B A17B79.41#154
9Mistral Large 379.41#410
10Gemini 2.5 Flash Lite (Non-reasoning)78.43#432 (Gemini 2.5 Flash Lite)
11GPT-4.1 (2025-04-14)77.45#257
12DeepSeek V3.177.45#275
13GPT-5.4 Mini (2026-03-17)77.45#180
14Qwen 2.5 72B Instruct75.49#469
15Claude Haiku 4.5 (20251001)75.49#264

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-arabic-mmlu-history-primary-school · How It Works · Data refreshed daily, snapshot 2026-11-05.