DeceptionBench Real-World - Reward: leaderboard
The model answers one of 150 everyday scenarios (economy, healthcare, education, social, entertainment) with a single-turn reward motive added (Level 2); the number is the share of responses a GPT-4o judge marks as deceiving the user against what the model holds true. Unlike the PKU DeceptionBench (Mesa-Utility), deception is judged against the scenario's facts, not a belief the model stated earlier.
Metric: Response deception rate (%, lower is better). Source: arxiv.org. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.7 Sonnet | 0.33 | #458 |
| 2 | Claude 3.5 Sonnet | 0.33 | #746 |
| 3 | GPT-4o | 28.67 | #741 |
| 4 | Qwen 2.5 14B Instruct | 29 | #1732 |
| 5 | Qwen Max | 32.33 | #1051 |
| 6 | Grok 3 | 45.33 | #602 |
| 7 | Gemini 1.5 Pro | 52.33 | #1049 |
| 8 | Gemini 2.0 Flash | 52.35 | #704 |
| 9 | Qwen 2.5 7B Instruct | 57.67 | #2564 |
| 10 | DeepSeek R1 | 61 | #473 |
| 11 | QwQ-32B | 63.33 | #910 |
| 12 | GPT-3.5 Turbo | 63.33 | #2753 |
| 13 | DeepSeek R1 Distill Qwen 14B | 78.67 | #2582 |
| 14 | DeepSeek-R1-Distill-Qwen-7B | 85.33 | #7996 |
Interactive version: theaggregate.ai/benchmark?slug=deceptionbench-real-world-reward · How It Works · Data refreshed daily, snapshot 2026-11-13.