Jais 3 Model Cards - Arabic Linguistics - Parsing (IFM): leaderboard

IFM's Arabic grammatical parsing task (benchmark not yet released). MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 29 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 31B (IT)98.3#174
2Gemma 4 12B (IT)97.4#371
3Qwen3.8-Flash-Next96.9#69
4Qwen 3.5 397B A17B95.9#144
5Nemotron 3 Ultra94.3#234
6Muse Glimmer 30B94.1#178
7gemma-4-E4B-it91.6#566
8Qwen 3.8 27B89.8#104
9MiniMax-M387.7#137
10Gemma 4 E2B81.6#1076
11Qwen 3.5 9B80.2#377
12Qwen 3.5 4B66.3#473
13Falcon-H1-34B-Instruct49.7#666
14Fanar-1-9B-Instruct46.9#633
15Falcon-H1-7B-Instruct46.4#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-arabic-linguistics-parsing-ifm · How It Works · Data refreshed daily, snapshot 2026-10-19.