DeceptionBench Real-World: leaderboard
The model answers one of 150 everyday scenarios (economy, healthcare, education, social, entertainment) with no inducement (Level 1); the number is the share of responses a GPT-4o judge marks as deceiving the user against what the model holds true. Unlike the PKU DeceptionBench (Mesa-Utility), deception is judged against the scenario's facts, not a belief the model stated earlier.
Metric: Response deception rate (%, lower is better). Source: arxiv.org. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.5 Sonnet | 2 | #746 |
| 2 | Claude 3.7 Sonnet | 2.67 | #458 |
| 3 | GPT-4o | 30.67 | #741 |
| 4 | Qwen 2.5 14B Instruct | 31.33 | #1732 |
| 5 | Qwen Max | 34.67 | #1051 |
| 6 | Grok 3 | 42 | #602 |
| 7 | Gemini 2.0 Flash | 44.3 | #704 |
| 8 | Gemini 1.5 Pro | 46 | #1049 |
| 9 | Qwen 2.5 7B Instruct | 50.67 | #2564 |
| 10 | DeepSeek R1 | 50.67 | #473 |
| 11 | QwQ-32B | 50.67 | #910 |
| 12 | GPT-3.5 Turbo | 56 | #2753 |
| 13 | DeepSeek R1 Distill Qwen 14B | 66 | #2582 |
| 14 | DeepSeek-R1-Distill-Qwen-7B | 73.33 | #7996 |
Interactive version: theaggregate.ai/benchmark?slug=deceptionbench-real-world · How It Works · Data refreshed daily, snapshot 2026-11-13.