HalluScore - Reasoning: leaderboard
HalluScore (2026) is an Arabic question-answering benchmark of 827 hallucination-prone Modern Standard Arabic questions, with human annotation of model answers. This board is the factual hallucination rate, the percent of answers that state an unsupported fact with confidence on the 220 questions that require reasoning, zero-shot at temperature 0 (expressed uncertainty or refusal does not count); lower is better.
Metric: Factual hallucination rate (%) on the 220 HalluScore questions that require reasoning, zero-shot short-answer Arabic question answering at temperature 0 with no retrieval, responses annotated by humans; an answer that states an unsupported fact with confidence counts, an expressed uncertainty or refusal does not; lower is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5 | 20.91 | #185 | |
| 2 | Claude Opus 4 | 26.82 | #332 | |
| 3 | Claude Sonnet 4.5 | 30.91 | #267 | |
| 4 | O4 Mini | 35.91 | #372 | |
| 5 | Grok 4 Fast | Reasoning | 42.73 | #446 |
| 6 | GPT-4o | 43.18 | #754 | |
| 7 | DeepSeek V3 | 46.82 | #736 | |
| 8 | DeepSeek R1 | 50.91 | #484 | |
| 9 | Llama 4 Maverick Instruct FP8 | 51.36 | #1034 | |
| 10 | Qwen 3 Next 80B A3B Instruct | 60.91 | #781 | |
| 11 | Qwen3-235B-A22B-Instruct-2507-tput | 61.36 | #557 | |
| 12 | Grok 4 | 62.73 | #321 | |
| 13 | ALLaM-7B-Instruct-preview | 68.64 | #1992 | |
| 14 | O3 | 77.73 | #242 | |
| 15 | Fanar-1-9B | 80.91 | #1925 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=halluscore-reasoning · How It Works · Data refreshed daily, snapshot 2026-11-22.