JailNewsBench (System Override): leaderboard
Metric: Attack success rate (%): share of model outputs that do not refuse, as judged jointly by GPT-5, Gemini 2.5 and Claude 4, on JailNewsBench test-split fake-news generation instructions (seed instructions built from real news articles of 34 regions in 22 languages, each with a financial, political, social or psychological motive), averaged across regions, under the System Override jailbreak (the instruction is prefixed with a directive to ignore previous instructions and system prompts); lower is better. Source: arxiv.org. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 78 | #91 |
| 2 | Claude Sonnet 4 | 79.2 | #194 |
| 3 | Gemini 2.5 Flash | 81.2 | #237 |
| 4 | DeepSeek R1 Distill Llama 70B | 86.5 | #582 |
| 5 | DeepSeek R1 Distill Llama 8B | 86.5 | #1282 |
| 6 | Llama 3.1 8B Instruct | 86.8 | #1018 |
| 7 | Llama 3.1 70B Instruct | 90 | #548 |
Interactive version: theaggregate.ai/benchmark?slug=jailnewsbench-system-override · How It Works · Data refreshed daily, snapshot 2026-10-11.