Jais 3 Model Cards - AraGen v3 (3C3H): leaderboard

AraGen v3 (09-2025) open-ended Arabic generation, judged on correctness, completeness, conciseness, helpfulness, honesty and harmlessness (the 3C3H score). MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: 3C3H Score (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: 3C3H Score (%). Source: huggingface.co. Saturation forecast: Around January 2027. 29 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 397B A17B78.9#144
2Muse Glimmer 30B75.6#178
3Qwen3.8-Flash-Next74.9#69
4Gemma 4 31B (IT)73.4#174
5Nemotron 3 Ultra72.8#234
6MiniMax-M371.9#137
7Qwen 3.8 27B66.7#104
8Gemma 4 12B (IT)62.8#371
9Qwen 3.5 9B55.7#377
10gemma-4-E4B-it48.8#566
11Qwen 3.5 4B45.8#473
12Falcon-H1-34B-Instruct45#666
13Fanar-1-9B-Instruct40.1#633
14Gemma 4 E2B39.6#1076
15Falcon-H1-7B-Instruct28#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-aragen-v3-3c3h · How It Works · Data refreshed daily, snapshot 2026-10-19.