HaluCheck - English - HaluAgent Accuracy: leaderboard
Bilingual hallucination detection: factual perturbations in text (HaluReal), fabricated entities (HaluFake) and faithfulness hallucinations in agent trajectories (HaluAgent). HaluCheck v1 Lite evaluation sets (1,000 balanced HaluReal and 1,000 balanced HaluAgent samples per language; 500 HaluFake fabricated-entity samples per language); decoding temperature 0. Accuracy credits correct 1, uncertain 0.5, incorrect 0. SpanF1 matches predicted against gold hallucinated spans with an LLM matcher; CorrectionRate requires correctly localized spans to be corrected. RootTurnAcc identifies the earliest hallucinated agent turn. UncertainRate (abstention) and HaluFake recall on an all-fabricated set are not admitted: they measure disposition, and always flagging scores 100. Main-table thinking mode and reasoning effort are not stated (Figure 4 separately varies Qwen3 thinking); model rows keep their native checkpoints. Question access: Code repository github.com/xMiles/HaluCheck is cited; the exact Lite split release was not verified.
Metric: Uncertainty-aware detection accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.4 (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 72.36 | |
| 2 | Gemini 3.1 Pro (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 72.28 | |
| 3 | Gemini 3 Flash (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 72.12 | |
| 4 | GPT-5 Mini (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.73 | |
| 5 | Llama 3.3 70B Instruct (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.6 | |
| 6 | Qwen 3 235B A22B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.25 | |
| 7 | Qwen 3 32B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 68.8 | |
| 8 | DeepSeek V4 Flash (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 68.45 | |
| 9 | Qwen 3 14B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 67.77 | |
| 10 | Qwen 3 30B A3B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 66.93 |
Interactive version: theaggregate.ai/benchmark?slug=halucheck-english-haluagent-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-07.