LexAgentHallu - LawThinker - L1 Hallucination Frequency: leaderboard
LexAgentHallu evaluates hallucinations in multi-step legal agents. L1 covers substantive legal knowledge and L2 procedural reasoning. Hallucination frequency is the fraction of rollouts with at least one flagged error; density is the mean fraction of applicable error subclasses triggered. Frameworks are separate protocols; the LRAS fine-tuned models retain their own identities. This series reports LexAgentHallu - LawThinker - L1 Hallucination Frequency from 2609.09754v1, S4.T2: Hallucination Frequency (%). Lower is better.
Metric: Hallucination Frequency (%). Source: arxiv.org. Saturation forecast: Around 2030. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 88.1 | #93 |
| 2 | Qwen 3.5 27B | 89.1 | #368 |
| 3 | GPT-5.4 | 90 | #125 |
| 4 | Qwen 3.6 27B | 90.6 | #345 |
| 5 | Qwen 3.5 9B | 94.4 | #862 |
No result here: #4 Claude Opus 5.5, #5 GPT-6 Astra, #9 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=lexagenthallu-lawthinker-l1-hallucination-frequency · How It Works · Data refreshed daily, snapshot 2026-11-08.