Arabic Broad Leaderboard: leaderboard

Arabic Broad Benchmark: 470 human checked questions drawn from 64 Arabic datasets, covering 22 skills from grammar, dialect and diacritization to reasoning, translation and function calling. Each answer is scored 0 to 10 by a mix of manual rules and skill specific GPT-4.1 judging, and the board reports the average across questions, higher is better. Source: huggingface.co/blog/silma-ai/arabic-llm-leaderboard.

Metric: Average Score (0-10). Source: huggingface.co. Saturation forecast: Estimated already saturated. 121 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.5 Flash9.25#60
2Gemini 3.1 Pro (Preview)9.21#58
3Gemini 3 Pro (Preview)9.2#66
4Gemini 3.7 Flash9.2#23
5Muse Spark 1.19.2#52
6Gemini 3.1 Flash Lite9.14#191
7DeepSeek V4.1 Flash9.14#36
8Gemini 3.8 Flash9.14#21
9Gemini 4 Argon9.13#8
10GLM-59.06#141
11GPT-6.1 Pro Sol9.05#13
12GPT-4o9.02#343
13Gemini 2.5 Pro (Preview 05-06)8.99#147
14Gemma 4 31B (IT)8.98#176
15GPT-5.58.98#31

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=arabic-broad-leaderboard · How It Works · Data refreshed daily, snapshot 2026-10-20.