AuthorityBench - Fabricated Citations on True Claims: leaderboard

AuthorityBench (2026) isolates how citation-based authority cues change LLM behaviour by crossing true and false claims with real and fabricated citations in four domains. This board is the hallucination rate in percent on true claims presented with a fabricated citation, judged by Qwen3-8B; lower is better.

Metric: Hallucination rate (%) on true claims presented with a fabricated citation (TC x FC condition): share of non-refused responses a Qwen3-8B judge labels hallucinated (the model denies or distorts the true claim); 15K stratified subset for four models, full dataset for Gemma 3 4B, Llama 3.1 8B Instruct and Phi-4 Mini Instruct; lower is better. Source: arxiv.org. Saturation forecast: Around March 2027. 7 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V3.216.28#406
2Gemma 4 31B22.73#394
3Gemma 3 4B24.14#5064
4GPT-5.4 Mini37.27#389
5Phi-4 Mini Instruct40.63#6419
6Llama 3.1 8B Instruct43.76#4246
7Claude Haiku 4.547.11#568

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=authoritybench-fabricated-citations-on-true-claims · How It Works · Data refreshed daily, snapshot 2026-11-13.