QIMMA - Overall: leaderboard

QIMMA (Technology Innovation Institute) Arabic LLM leaderboard average over 14 native-Arabic benchmarks spanning STEM, law, medicine, culture, poetry, safety and code, with MedArabiQ counted as the mean of its MCQ and QA parts. Open-weight models only; 0-100, higher is better. Multiple-choice sets are scored by log-likelihood, not generation.

Metric: Mean score across 14 benchmarks (%). Source: huggingface.co. Saturation forecast: Around September 2028. 83 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 397B A17B69.24#154
2Qwen 2.5 72B Instruct68.49#469
3AIC-167.85#235
4Jais-2-70B-Chat67.77#430
5Llama 3.3 70B Instruct67.09#541
6Qwen 3.5 122B A10B66.33#184
7Qwen 2.5 32B Instruct66.09#509
8Gemma 3 27B (IT)63.84#528
9AceGPT-v2-32B-Chat62.96#518
10Gemma 3 12B (IT)62.65#672
11Qwen 3.5 27B62.01#192
12Qwen 3.5 35B A3B61.16#268
13Gemma 4 31B (IT)60.38#178
14Jais-2-8B-Chat59.33#802
15Qwen 2.5 14B Instruct59.29#654

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=qimma-overall · How It Works · Data refreshed daily, snapshot 2026-11-05.