HELM Arabic - Mbzuai Human Translated Arabic Mmlu - Human Aging: leaderboard

HELM Arabic (release v2.2.0) MBZUAI human-translated Arabic MMLU, Human Aging: the MMLU four-option questions for this subject translated into Arabic by human translators; 223 questions, exact match. Percent correct, 0-100, higher is better; guessing scores 25.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Around February 2027. 41 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.782.96#51
2Claude Haiku 4.5 (20251001)78.92#264
3Claude Sonnet 4.678.48#94
4Qwen 3.5 397B A17B77.58#154
5GPT-5.1 (2025-11-13)77.13#107
6Gemini 2.5 Flash (Non-reasoning)75.78#255 (Gemini 2.5 Flash)
7GPT-5.4 (2026-03-05)74.89#63
8Qwen 3 Next 80B A3B Instruct73.99#381
9Gemma 4 31B (IT)73.54#178
10GPT-4.1 (2025-04-14)72.2#257
11Qwen 2.5 72B Instruct71.75#469
12Gemini 2.5 Flash Lite (Non-reasoning)71.75#432 (Gemini 2.5 Flash Lite)
13Mistral Large 371.3#410
14Mistral Large 2 (Nov) Instruct (2411)71.3#480
15GPT-5.4 Mini (2026-03-17)71.3#180

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-mbzuai-human-translated-arabic-mmlu-human-aging · How It Works · Data refreshed daily, snapshot 2026-11-05.