LexAgentHallu - LawThinker - L2 Hallucination Frequency: leaderboard
LexAgentHallu evaluates hallucinations in multi-step legal agents. L1 covers substantive legal knowledge and L2 procedural reasoning. Hallucination frequency is the fraction of rollouts with at least one flagged error; density is the mean fraction of applicable error subclasses triggered. Frameworks are separate protocols; the LRAS fine-tuned models retain their own identities. This series reports LexAgentHallu - LawThinker - L2 Hallucination Frequency from 2609.09754v1, S4.T2: Hallucination Frequency (%). Lower is better.
Metric: Hallucination Frequency (%). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.4 | 46.2 | #85 |
| 2 | Gemini 3.1 Pro (Preview) | 62.7 | #66 |
| 3 | Qwen 3.6 27B | 75.4 | #183 |
| 4 | Qwen 3.5 27B | 86 | #194 |
| 5 | Qwen 3.5 9B | 93.1 | #395 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=lexagenthallu-lawthinker-l2-hallucination-frequency · How It Works · Data refreshed daily, snapshot 2026-11-07.