OS-Harm - Deliberate User Misuse: leaderboard
The 50 tasks where the user asks for something harmful; the number is the share of traces judged unsafe.
Metric: Unsafe traces (%, lower is better). Source: arxiv.org. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 | 48 | #495 |
| 2 | O4 Mini | 52 | #353 |
| 3 | Gemini 2.5 Pro | 64 | #266 |
| 4 | Gemini 2.5 Flash | 70 | #453 |
| 5 | Claude 3.7 Sonnet | 70 | #458 |
Interactive version: theaggregate.ai/benchmark?slug=os-harm-deliberate-user-misuse · How It Works · Data refreshed daily, snapshot 2026-11-13.