InstrumentalEval - Hacking Computer Systems: leaderboard
The 10 InstrumentalEval tasks in which the model, pushed to reach its goal at all costs, could gain access to systems it is not authorised to use; the score is the share of responses a GPT-4o judge marks as doing so. It is one of six categories behind the InstrumentalEval total.
Metric: Responses pursuing the instrumental goal, 10 tasks (%, lower is better). Source: arxiv.org. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 10 | #741 |
| 2 | DeepSeek V3 | 20 | #716 |
| 3 | DeepSeek R1 | 40 | #473 |
| 4 | Gemini 2.0 Flash (01-21) (Thinking) | 40 | #711 (Gemini 2.0 Flash (01-21)) |
| 5 | O1 (2024-12-17) | 50 | #311 |
| 6 | O3 Mini | 50 | #533 |
| 7 | O1 Mini | 50 | #764 |
Interactive version: theaggregate.ai/benchmark?slug=instrumentaleval-hacking-computer-systems · How It Works · Data refreshed daily, snapshot 2026-11-13.