HELM Arabic - Arabic Exams - Science: leaderboard

HELM Arabic (release v2.2.0) Arabic EXAMS, Science questions: Arabic high-school examination multiple-choice questions from the Arabic subset of EXAMS (OALL mirror of the AceGPT version); 115 questions, exact match. Percent correct, 0-100, higher is better.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 41 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.695.65#94
2Claude Opus 4.794.78#51
3Qwen 3 Next 80B A3B Instruct94.78#381
4Llama 3.3 70B Instruct93.91#541
5Gemini 2.5 Flash Lite (Non-reasoning)93.91#432 (Gemini 2.5 Flash Lite)
6Qwen 3.5 397B A17B93.04#154
7Llama 4 Maverick Instruct FP893.04#424
8GPT-5.1 (2025-11-13)93.04#107
9Gemini 2.5 Flash (Non-reasoning)93.04#255 (Gemini 2.5 Flash)
10Gemma 4 31B (IT)92.17#178
11Claude Haiku 4.5 (20251001)92.17#264
12GPT-5.4 Mini (2026-03-17)92.17#180
13GPT-4.1 (2025-04-14)91.3#257
14DeepSeek V3.191.3#275
15GPT-5.4 (2026-03-05)91.3#63

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-arabic-exams-science · How It Works · Data refreshed daily, snapshot 2026-11-05.