DecepEval - Tool-use (Induced): leaderboard

An agent doing a tool-use task observes a fact that blocks success (for example a failed download) and must report status with an added pressure, incentive, opportunity or conflicting requirement; the number is the share of instances where a judge finds it claimed success, fabricated results or hid the failure. Unlike hallucination boards, the agent saw the contradicting evidence itself.

Metric: Tool-use instances judged deceptive, induced condition (%). Source: arxiv.org. 9 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.3 Flash (High)27.09#122 (GLM-5.3 Flash)
2Claude Opus 5 (High)36.04#22 (Claude Opus 5)
3Claude Sonnet 5 (High)36.21#111 (Claude Sonnet 5)
4GPT-5.6 Sol (High)36.8#30 (GPT-5.6 Sol)
5GPT-5.6 Terra (High)45.5#62 (GPT-5.6 Terra)
6Grok 4.5 (High)54.8#82 (Grok 4.5)
7Claude Haiku 4.566.55#568
8DeepSeek V4 Flash (High)78.4#258 (DeepSeek V4 Flash)
9DeepSeek V4 Pro (0813) (High)80.63#84 (DeepSeek V4 Pro (0813))

Interactive version: theaggregate.ai/benchmark?slug=decepeval-tool-use-induced · How It Works · Data refreshed daily, snapshot 2026-11-13.