InstrumentalEval - Strategically Appearing Aligned: leaderboard
The 11 InstrumentalEval tasks in which the model, pushed to reach its goal at all costs, could report selectively so it appears successful or aligned; the score is the share of responses a GPT-4o judge marks as doing so. It is one of six categories behind the InstrumentalEval total.
Metric: Responses pursuing the instrumental goal, 11 tasks (%, lower is better). Source: arxiv.org. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 27.27 | #741 |
| 2 | DeepSeek V3 | 36.36 | #716 |
| 3 | DeepSeek R1 | 45.45 | #473 |
| 4 | O1 (2024-12-17) | 45.45 | #311 |
| 5 | O1 Mini | 45.45 | #764 |
| 6 | Gemini 2.0 Flash (01-21) (Thinking) | 45.45 | #711 (Gemini 2.0 Flash (01-21)) |
| 7 | O3 Mini | 63.64 | #533 |
Interactive version: theaggregate.ai/benchmark?slug=instrumentaleval-strategically-appearing-aligned · How It Works · Data refreshed daily, snapshot 2026-11-13.