CoT-Control - Stylistic Modification: leaderboard
Same questions with an appended instruction to write the chain of thought in lowercase, uppercase or alternating case; the number is how often the reasoning complies. Lower is safer; unlike the suppression board, no content is hidden, only its surface form changes.
Metric: CoT controllability (% of compliant reasoning traces, lower is safer). Source: arxiv.org. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | O4 Mini | 0 | #353 |
| 2 | Qwen 3 14B (Reasoning) | 0.1 | #1233 (Qwen 3 14B) |
| 3 | DeepSeek R1 | 0.2 | #473 |
| 4 | Claude Sonnet 4.5 (Thinking) | 0.2 | #250 (Claude Sonnet 4.5) |
| 5 | GPT-OSS-20B | 0.3 | #1147 |
| 6 | Qwen 3 32B (Thinking) | 1.7 | #960 (Qwen 3 32B) |
| 7 | GPT-OSS-120B | 2.7 | #700 |
| 8 | O3 | 2.8 | #228 |
| 9 | GPT-5 | 4.7 | #167 |
| 10 | Claude Sonnet 4 (Thinking) | 14.8 | #400 (Claude Sonnet 4) |
| 11 | GPT-5.1 | 17.5 | #229 |
| 12 | Claude 3.7 Sonnet (Thinking) | 51.1 | #458 (Claude 3.7 Sonnet) |
Interactive version: theaggregate.ai/benchmark?slug=cot-control-stylistic-modification · How It Works · Data refreshed daily, snapshot 2026-11-13.