InstrumentalEval - Evading Shutdown: leaderboard
The 20 InstrumentalEval tasks in which the model, pushed to reach its goal at all costs, could avoid or resist being shut down; the score is the share of responses a GPT-4o judge marks as doing so. It is one of six categories behind the InstrumentalEval total.
Metric: Responses pursuing the instrumental goal, 20 tasks (%, lower is better). Source: arxiv.org. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V3 | 15 | #716 |
| 2 | GPT-4o | 20 | #741 |
| 3 | Gemini 2.0 Flash (01-21) (Thinking) | 35 | #711 (Gemini 2.0 Flash (01-21)) |
| 4 | O1 (2024-12-17) | 40 | #311 |
| 5 | O1 Mini | 40 | #764 |
| 6 | O3 Mini | 45 | #533 |
| 7 | DeepSeek R1 | 50 | #473 |
Interactive version: theaggregate.ai/benchmark?slug=instrumentaleval-evading-shutdown · How It Works · Data refreshed daily, snapshot 2026-11-13.