Jais 3 Model Cards - QADI Dialect Identification: leaderboard

QADI country-level Arabic dialect identification. MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects all six cards. The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around March 2028. 29 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 4 31B (IT)70.4#174
2Qwen 3.5 397B A17B62.3#144
3Gemma 4 12B (IT)62.1#371
4Nemotron 3 Ultra60.8#234
5Muse Glimmer 30B60.6#178
6Qwen3.8-Flash-Next60.5#69
7gemma-4-E4B-it59.8#566
8MiniMax-M352.8#137
9Qwen 3.8 27B51.5#104
10Falcon-H1-34B-Instruct50.3#666
11Fanar-1-9B-Instruct46.2#633
12Gemma 4 E2B44.4#1076
13granite-4.0-h-3B-ar42.2#1133
14Tiny Aya Global38.8#1322
15Falcon-H1-7B-Instruct38.1#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-qadi-dialect-identification · How It Works · Data refreshed daily, snapshot 2026-10-19.