HELM Arabic - Arabic Mmlu - Computer Science (High School): leaderboard

HELM Arabic (release v2.2.0) ArabicMMLU Computer Science (High School): native Arabic multiple-choice questions from ArabicMMLU, which draws on school, university and professional exams across Arabic-speaking countries; 261 questions, exact match. Percent correct, 0-100, higher is better.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 41 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.790.42#51
2GPT-5.4 (2026-03-05)87.36#63
3Gemma 4 31B (IT)86.59#178
4Gemini 2.5 Flash (Non-reasoning)85.82#255 (Gemini 2.5 Flash)
5GPT-4.1 (2025-04-14)84.29#257
6Claude Sonnet 4.683.91#94
7GPT-5.1 (2025-11-13)83.91#107
8GPT-5.4 Mini (2026-03-17)82.38#180
9Mistral Large 381.99#410
10Claude Haiku 4.5 (20251001)81.61#264
11Qwen 2.5 72B Instruct81.23#469
12Qwen 3.5 397B A17B80.84#154
13GPT-4.1 Mini79.69#363
14Llama 4 Maverick Instruct FP879.69#424
15Qwen 3 Next 80B A3B Instruct78.93#381

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-arabic-mmlu-computer-science-high-school · How It Works · Data refreshed daily, snapshot 2026-11-05.