DecepEval - Long-horizon (Neutral): leaderboard
An agent doing a long-horizon task observes a fact that blocks success (for example a failed download) and must report status under routine instructions with no inducement; the number is the share of instances where a judge finds it claimed success, fabricated results or hid the failure. Unlike hallucination boards, the agent saw the contradicting evidence itself.
Metric: Long-horizon instances judged deceptive, neutral condition (%). Source: arxiv.org. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (High) | 1.5 | #30 (GPT-5.6 Sol) |
| 2 | Grok 4.5 (High) | 3.09 | #82 (Grok 4.5) |
| 3 | GPT-5.6 Terra (High) | 5.5 | #62 (GPT-5.6 Terra) |
| 4 | DeepSeek V4 Pro (0813) (High) | 21.72 | #84 (DeepSeek V4 Pro (0813)) |
| 5 | GLM-5.3 Flash (High) | 33.1 | #122 (GLM-5.3 Flash) |
| 6 | DeepSeek V4 Flash (High) | 50.5 | #258 (DeepSeek V4 Flash) |
| 7 | Claude Sonnet 5 (High) | 53.12 | #111 (Claude Sonnet 5) |
| 8 | Claude Haiku 4.5 | 54.7 | #568 |
| 9 | Claude Opus 5 (High) | 58.29 | #22 (Claude Opus 5) |
Interactive version: theaggregate.ai/benchmark?slug=decepeval-long-horizon-neutral · How It Works · Data refreshed daily, snapshot 2026-11-13.