AraGen: leaderboard

Arabic generative benchmark using the six-dimension 3C3H metric across QA, grammar, reasoning, and safety tasks. This board uses the v3 question set and Claude Sonnet 4 judge, preserving the published point estimates and distinct precision configurations.

Metric: 3C3H Score (%). Source: huggingface.co. Saturation forecast: Around January 2027. 69 models tracked.

Top models

#ModelScoreOverall rank
1O1 (2024-12-17)84.29#149
2GPT-584.25#98
3O3 (2025-04-16)82.19#121
4Claude Opus 4 (20250514)80.96#154
5Claude Opus 4.5 (20251101)80.29#74
6Claude Sonnet 4.578.17#142
7Claude 3.7 Sonnet (20250219)78.16#201
8Claude Sonnet 4 (20250514)75.58#213
9GPT-4.174.54#248
10Gemma 4 31B (IT)72.71#176
11O4 Mini (2025-04-16)70.6#179
12O1 Mini (2024-09-12)70.46#403
13Gemini 2.5 Pro (Preview 05-06)68.37#147
14Gemma 4 26B A4B (IT)67.35#297
15Claude Haiku 4.5 (20251001)65.8#261

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=aragen · How It Works · Data refreshed daily, snapshot 2026-10-20.