Correction Suppression Benchmark: leaderboard

LLMs reliably correct false claims when presented in isolation, yet when the same claims are embedded in task-oriented requests, they often comply rather than correct. We term this failure mode correction suppression and construct a benchmark of 300 false premises to systematically evaluate it across eight models. Suppression rates range from 19% to 90%, with four models exceeding 80%, establishin

Metric: Suppression Rate (self-reported). Source: benchmarklist.com. Saturation forecast: Not forecast. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.189.6#135
2DeepSeek V3.284#205
3Gemini 3 Flash82.9#99
4Grok 4.1 Fast81.2#217
5Llama 3.1 8B47.4#1151
6Qwen 3.5 9B46#379
7Claude Sonnet 4.531#142
8Qwen 3.5 Plus19.3#125

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=correction-suppression-benchmark · How It Works · Data refreshed daily, snapshot 2026-10-20.