Jais 3 Model Cards - AA-LCR (Arabic): leaderboard

Arabic version of the AA-LCR long-context reasoning questions. MBZUAI's Institute of Foundation Models reported this on the Jais 3 model cards (released October 15, 2026), comparing each Jais 3 size with size-matched reference models; this board collects the 4 cards that report it (7B, 32B, MoVA-36B-A4B and 375B-A23B). The cards state that all reported results use high reasoning effort. Vendor-reported. Metric: Accuracy (%). Higher is better. Source: https://huggingface.co/collections/IFM/jais-3-6abba9df4f1173ec7ce2929d

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around January 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1MiniMax-M380#137
2Qwen 3.8 27B79#104
3Qwen 3.5 397B A17B78#144
4Qwen3.8-Flash-Next74#69
5Nemotron 3 Ultra73#234
6Qwen 3.5 9B68#377
7Gemma 4 31B (IT)66#174
8Gemma 4 12B (IT)49#371
9Falcon-H1-34B-Instruct14#666
10Falcon-H1-7B-Instruct9#1043

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=jais-3-model-cards-aa-lcr-arabic · How It Works · Data refreshed daily, snapshot 2026-10-19.