LexAgentHallu - Plan-and-Execute - L1 Hallucination Frequency: leaderboard
LexAgentHallu evaluates hallucinations in multi-step legal agents. L1 covers substantive legal knowledge and L2 procedural reasoning. Hallucination frequency is the fraction of rollouts with at least one flagged error; density is the mean fraction of applicable error subclasses triggered. Frameworks are separate protocols; the LRAS fine-tuned models retain their own identities. This series reports LexAgentHallu - Plan-and-Execute - L1 Hallucination Frequency from 2609.09754v1, S4.T2: Hallucination Frequency (%). Lower is better.
Metric: Hallucination Frequency (%). Source: arxiv.org. Saturation forecast: Around 2029. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 88.2 | #91 |
| 2 | Qwen 3.6 27B | 89.2 | #339 |
| 3 | GPT-5.4 | 90.5 | #121 |
| 4 | Qwen 3.5 27B | 90.6 | #358 |
| 5 | Qwen 3.5 9B | 92.1 | #803 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=lexagenthallu-plan-and-execute-l1-hallucination-frequency · How It Works · Data refreshed daily, snapshot 2026-11-12.