DeceptionBench Real-World - Pressure: leaderboard
The model answers one of 150 everyday scenarios (economy, healthcare, education, social, entertainment) with a single-turn pressure motive added (Level 2); the number is the share of responses a GPT-4o judge marks as deceiving the user against what the model holds true. Unlike the PKU DeceptionBench (Mesa-Utility), deception is judged against the scenario's facts, not a belief the model stated earlier.
Metric: Response deception rate (%, lower is better). Source: arxiv.org. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.5 Sonnet | 0 | #746 |
| 2 | Claude 3.7 Sonnet | 0.33 | #458 |
| 3 | GPT-4o | 31 | #741 |
| 4 | Qwen Max | 40.33 | #1051 |
| 5 | Qwen 2.5 14B Instruct | 41 | #1732 |
| 6 | Grok 3 | 49.67 | #602 |
| 7 | Gemini 2.0 Flash | 56.04 | #704 |
| 8 | GPT-3.5 Turbo | 58.67 | #2753 |
| 9 | Qwen 2.5 7B Instruct | 59 | #2564 |
| 10 | Gemini 1.5 Pro | 60.33 | #1049 |
| 11 | QwQ-32B | 61.33 | #910 |
| 12 | DeepSeek R1 | 63 | #473 |
| 13 | DeepSeek-R1-Distill-Qwen-7B | 76.33 | #7996 |
| 14 | DeepSeek R1 Distill Qwen 14B | 77 | #2582 |
Interactive version: theaggregate.ai/benchmark?slug=deceptionbench-real-world-pressure · How It Works · Data refreshed daily, snapshot 2026-11-13.