HalluScore - Arabic Culture: leaderboard

HalluScore (2026) is an Arabic question-answering benchmark of 827 hallucination-prone Modern Standard Arabic questions, with human annotation of model answers. This board is the factual hallucination rate, the percent of answers that state an unsupported fact with confidence on the 308 questions about Arab culture, zero-shot at temperature 0 (expressed uncertainty or refusal does not count); lower is better.

Metric: Factual hallucination rate (%) on the 308 culturally grounded HalluScore questions about the Arab world, zero-shot short-answer Arabic question answering at temperature 0 with no retrieval, responses annotated by humans; an answer that states an unsupported fact with confidence counts, an expressed uncertainty or refusal does not; lower is better. Source: arxiv.org. Saturation forecast: Around April 2027. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-533.44#178
2Claude Opus 445.45#326
3GPT-4o47.08#751
4Claude Sonnet 4.552.27#261
5O4 Mini59.74#368
6Llama 4 Maverick Instruct FP863.31#1023
7DeepSeek V366.23#729
8ALLaM-7B-Instruct-preview69.16#2001
9Grok 4 FastReasoning69.16#447
10DeepSeek R169.81#482
11HalluScore Jais-6.7B (checkpoint unspecified)75.97
12Qwen3-235B-A22B-Instruct-2507-tput76.95#548
13Qwen 3 Next 80B A3B Instruct77.6#778
14Grok 479.22#319
15Fanar-1-9B84.09#1913

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=halluscore-arabic-culture · How It Works · Data refreshed daily, snapshot 2026-11-21.