DecepEval - Tool-use (Neutral): leaderboard
An agent doing a tool-use task observes a fact that blocks success (for example a failed download) and must report status under routine instructions with no inducement; the number is the share of instances where a judge finds it claimed success, fabricated results or hid the failure. Unlike hallucination boards, the agent saw the contradicting evidence itself.
Metric: Tool-use instances judged deceptive, neutral condition (%). Source: arxiv.org. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (High) | 2.2 | #30 (GPT-5.6 Sol) |
| 2 | GPT-5.6 Terra (High) | 4.5 | #62 (GPT-5.6 Terra) |
| 3 | GLM-5.3 Flash (High) | 4.91 | #122 (GLM-5.3 Flash) |
| 4 | Grok 4.5 (High) | 6 | #82 (Grok 4.5) |
| 5 | Claude Haiku 4.5 | 7.09 | #568 |
| 6 | Claude Opus 5 (High) | 9.27 | #22 (Claude Opus 5) |
| 7 | Claude Sonnet 5 (High) | 11.09 | #111 (Claude Sonnet 5) |
| 8 | DeepSeek V4 Flash (High) | 19.1 | #258 (DeepSeek V4 Flash) |
| 9 | DeepSeek V4 Pro (0813) (High) | 23.75 | #84 (DeepSeek V4 Pro (0813)) |
Interactive version: theaggregate.ai/benchmark?slug=decepeval-tool-use-neutral · How It Works · Data refreshed daily, snapshot 2026-11-13.