DeceptionBench Real-World - Multi-turn Reward: leaderboard
The model answers one of 150 everyday scenarios (economy, healthcare, education, social, entertainment) with the reward motive escalated over several turns (Level 3); the number is the share of responses a GPT-4o judge marks as deceiving the user against what the model holds true. Unlike the PKU DeceptionBench (Mesa-Utility), deception is judged against the scenario's facts, not a belief the model stated earlier.
Metric: Response deception rate (%, lower is better). Source: arxiv.org. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.7 Sonnet | 0 | #458 |
| 2 | Claude 3.5 Sonnet | 0.33 | #746 |
| 3 | GPT-4o | 54 | #741 |
| 4 | Qwen Max | 73.67 | #1051 |
| 5 | GPT-3.5 Turbo | 82.33 | #2753 |
| 6 | Qwen 2.5 14B Instruct | 82.89 | #1732 |
| 7 | Gemini 2.0 Flash | 88.33 | #704 |
| 8 | Grok 3 | 88.33 | #602 |
| 9 | Qwen 2.5 7B Instruct | 89.6 | #2564 |
| 10 | DeepSeek R1 Distill Qwen 14B | 91.28 | #2582 |
| 11 | DeepSeek R1 | 91.97 | #473 |
| 12 | QwQ-32B | 93.58 | #910 |
| 13 | DeepSeek-R1-Distill-Qwen-7B | 94.26 | #7996 |
| 14 | Gemini 1.5 Pro | 94.33 | #1049 |
Interactive version: theaggregate.ai/benchmark?slug=deceptionbench-real-world-multi-turn-reward · How It Works · Data refreshed daily, snapshot 2026-11-13.