LexAgentHallu - LawThinker - L1 Hallucination Density: leaderboard
LexAgentHallu evaluates hallucinations in multi-step legal agents. L1 covers substantive legal knowledge and L2 procedural reasoning. Hallucination frequency is the fraction of rollouts with at least one flagged error; density is the mean fraction of applicable error subclasses triggered. Frameworks are separate protocols; the LRAS fine-tuned models retain their own identities. This series reports LexAgentHallu - LawThinker - L1 Hallucination Density from 2609.09754v1, S4.T2: Hallucination Density (%). Lower is better.
Metric: Hallucination Density (%). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 25.8 | #66 |
| 2 | GPT-5.4 | 27.9 | #85 |
| 3 | Qwen 3.6 27B | 30.1 | #183 |
| 4 | Qwen 3.5 27B | 30.4 | #194 |
| 5 | Qwen 3.5 9B | 35.5 | #395 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=lexagenthallu-lawthinker-l1-hallucination-density · How It Works · Data refreshed daily, snapshot 2026-11-07.