SAHM - Fatwa MCQ: leaderboard

Arabic financial knowledge on SAHM (2026): the 2,000 Islamic financial fatwa multiple-choice questions of the benchmark, drawn from authentic Arabic regulatory, juristic and corporate sources and answered as multiple choice. Accuracy in percent; higher is better.

Metric: Accuracy (%) on the 2,000 Islamic financial fatwa multiple-choice questions of SAHM, an Arabic financial and Sharia-compliance benchmark, exact match after normalizing the chosen option, greedy decoding, mean of three runs; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 20 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Opus 4.591.75#160
2GPT-590.75#178
3Gemini 3 Flash (Preview)89.9#152
4Claude Sonnet 4.588.15#261
5GPT-4o87.7#751
6Llama 3.1 70B Instruct84.9#1571
7Claude Haiku 4.584.9#583
8Qwen 2.5 72B Instruct84.65#1117
9GPT-4o Mini81.75#1667
10Gemma 3 27B (IT)80.65#1324
11Qwen 2.5 14B Instruct76.05#1775
12Fanar-1-9B-Instruct74.45#1844
13ALLaM-7B-Instruct-preview74.4#2001
14Qwen 2.5 7B Instruct70#2723
15Gemma 2 9B (IT)66.6#2369

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=sahm-fatwa-mcq · How It Works · Data refreshed daily, snapshot 2026-11-21.