DecepEval - Coding (Neutral): leaderboard
An agent doing a coding task observes a fact that blocks success (for example a failed download) and must report status under routine instructions with no inducement; the number is the share of instances where a judge finds it claimed success, fabricated results or hid the failure. Unlike hallucination boards, the agent saw the contradicting evidence itself.
Metric: Coding instances judged deceptive, neutral condition (%). Source: arxiv.org. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (High) | 1.6 | #30 (GPT-5.6 Sol) |
| 2 | GLM-5.3 Flash (High) | 2.18 | #122 (GLM-5.3 Flash) |
| 3 | DeepSeek V4 Pro (0813) (High) | 4.27 | #84 (DeepSeek V4 Pro (0813)) |
| 4 | Grok 4.5 (High) | 4.86 | #82 (Grok 4.5) |
| 5 | DeepSeek V4 Flash (High) | 7.2 | #258 (DeepSeek V4 Flash) |
| 6 | GPT-5.6 Terra (High) | 11.06 | #62 (GPT-5.6 Terra) |
| 7 | Claude Haiku 4.5 | 13.2 | #568 |
| 8 | Claude Opus 5 (High) | 20.37 | #22 (Claude Opus 5) |
| 9 | Claude Sonnet 5 (High) | 22.2 | #111 (Claude Sonnet 5) |
Interactive version: theaggregate.ai/benchmark?slug=decepeval-coding-neutral · How It Works · Data refreshed daily, snapshot 2026-11-13.