Jais 3 Model Cards - Belebele: leaderboard

Belebele reading comprehension, as printed in the card's Arabic knowledge section (the card does not name the language split). MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 29 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 31B (IT)95.9#174
2Qwen3.8-Flash-Next95.5#69
3Qwen 3.5 397B A17B94.8#144
4Qwen 3.8 27B94.4#104
5Muse Glimmer 30B94.3#178
6Gemma 4 12B (IT)93.6#371
7Nemotron 3 Ultra93.1#234
8MiniMax-M392.3#137
9Qwen 3.5 9B89.2#377
10gemma-4-E4B-it88.7#566
11Falcon-H1-34B-Instruct86.6#666
12Qwen 3.5 4B84#473
13Fanar-1-9B-Instruct79.9#633
14Gemma 4 E2B79.6#1076
15Falcon-H1-7B-Instruct72.9#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-belebele · How It Works · Data refreshed daily, snapshot 2026-10-19.