Jais 3 Model Cards - PaLM-X 2025-2 (IFM-audited): leaderboard

PalmX 2025 shared-task subtask 2 multiple-choice questions on Islamic culture, on IFM's audited set. MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 29 models tracked.

Top models

#ModelScoreOverall rank
1Qwen3.8-Flash-Next94.7#69
2Qwen 3.5 397B A17B94.6#144
3Gemma 4 31B (IT)94.5#174
4Nemotron 3 Ultra93.5#234
5MiniMax-M392.8#137
6Muse Glimmer 30B92.6#178
7Qwen 3.8 27B90.8#104
8Gemma 4 12B (IT)89.6#371
9Falcon-H1-34B-Instruct84.7#666
10Qwen 3.5 9B84.5#377
11gemma-4-E4B-it82.9#566
12Fanar-1-9B-Instruct80.3#633
13Qwen 3.5 4B79.6#473
14Gemma 4 E2B79.2#1076
15Falcon-H1-7B-Instruct74.3#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-palm-x-2025-2-ifm-audited · How It Works · Data refreshed daily, snapshot 2026-10-19.