CiteAudit (Generated) - Accuracy: leaderboard

Metric: Accuracy (fraction times 100) of the real-or-hallucinated verdicts on the CiteAudit generated test set (6,086 BibTeX references: 3,586 verified real ones and 2,500 fabricated variants with title, author or metadata errors, each validated by retrieval and human review); each language model classifies every reference as real or hallucinated through its API (tool access is not described); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.296.5#105
2Gemini 3 Pro81.4#77
3Mixtral 8x7B Instruct (v0.1)71#1049
4Llama 3.3 70B Instruct70.5#520
5Claude Sonnet 4.544.3#138

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=citeaudit-generated-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-11.