Jais 3 Model Cards - Arabic IFEval: leaderboard

Arabic IFEval instruction following. MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around January 2027. 29 models tracked.

Top models

#ModelScoreOverall rank
1Muse Glimmer 30B79.5#178
2Nemotron 3 Ultra79.2#234
3Qwen3.8-Flash-Next79.2#69
4Gemma 4 31B (IT)78.7#174
5Gemma 4 12B (IT)78.7#371
6Qwen 3.8 27B77#104
7Qwen 3.5 397B A17B74.5#144
8Qwen 3.5 9B73.8#377
9Qwen 3.5 4B73#473
10gemma-4-E4B-it72.3#566
11MiniMax-M370.1#137
12Gemma 4 E2B69.6#1076
13Falcon-H1-34B-Instruct66.8#666
14Qwen 3.5 2B62.6#1145
15Falcon-H1-7B-Instruct62.4#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-arabic-ifeval · How It Works · Data refreshed daily, snapshot 2026-10-19.