HELM Arabic - Arabic Mmlu - Biology (High School): leaderboard

HELM Arabic (release v2.2.0) ArabicMMLU Biology (High School): native Arabic multiple-choice questions from ArabicMMLU, which draws on school, university and professional exams across Arabic-speaking countries; 1,000 questions, exact match. Percent correct, 0-100, higher is better.

Metric: Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Around February 2027. 41 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.777.5#51
2Gemma 4 31B (IT)75.1#178
3GPT-5.4 (2026-03-05)74.5#63
4Gemini 2.5 Flash (Non-reasoning)72.9#255 (Gemini 2.5 Flash)
5Qwen 3.5 397B A17B71.5#154
6Claude Sonnet 4.671.2#94
7GPT-5.1 (2025-11-13)71.1#107
8GPT-4.1 (2025-04-14)71#257
9Llama 4 Maverick Instruct FP868.3#424
10GPT-5.4 Mini (2026-03-17)67.9#180
11Qwen 3 Next 80B A3B Instruct67.7#381
12Mistral Large 366.9#410
13Claude Haiku 4.5 (20251001)65.6#264
14Gemini 2.5 Flash Lite (Non-reasoning)64.9#432 (Gemini 2.5 Flash Lite)
15GPT-4.1 Mini64.2#363

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-arabic-arabic-mmlu-biology-high-school · How It Works · Data refreshed daily, snapshot 2026-11-05.