HaluCheck - English - HaluAgent Root-Turn Accuracy: leaderboard
Bilingual hallucination detection: factual perturbations in text (HaluReal), fabricated entities (HaluFake) and faithfulness hallucinations in agent trajectories (HaluAgent). HaluCheck v1 Lite evaluation sets (1,000 balanced HaluReal and 1,000 balanced HaluAgent samples per language; 500 HaluFake fabricated-entity samples per language); decoding temperature 0. Accuracy credits correct 1, uncertain 0.5, incorrect 0. SpanF1 matches predicted against gold hallucinated spans with an LLM matcher; CorrectionRate requires correctly localized spans to be corrected. RootTurnAcc identifies the earliest hallucinated agent turn. UncertainRate (abstention) and HaluFake recall on an all-fabricated set are not admitted: they measure disposition, and always flagging scores 100. Main-table thinking mode and reasoning effort are not stated (Figure 4 separately varies Qwen3 thinking); model rows keep their native checkpoints. Question access: Code repository github.com/xMiles/HaluCheck is cited; the exact Lite split release was not verified.
Metric: Root-turn accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 76.16 | |
| 2 | GPT-5.4 (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 73.31 | |
| 3 | Hy3-preview (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 73.16 | |
| 4 | DeepSeek V4 Flash (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 72.91 | |
| 5 | Gemini 3 Flash (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 72.76 | |
| 6 | DeepSeek V4 Pro (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 71.83 | |
| 7 | Qwen 3 235B A22B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.99 | |
| 8 | Llama 3.3 70B Instruct (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.43 | |
| 9 | GPT-5 Mini (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 70.24 | |
| 10 | Qwen 3 30B A3B (Benchmark Sweep Run: source=HaluCheck; Lite split; temperature=0; thinking/effort unreported) | 69.64 |
Interactive version: theaggregate.ai/benchmark?slug=halucheck-english-haluagent-root-turn-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-07.