SAD - Introspection: leaderboard
Metric: Score (%, higher is better). Source: situational-awareness-dataset.org. 21 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude 3.5 Sonnet | 39.1 |
| 2 | GPT-4 (0613) | 38.32 |
| 3 | Llama 2 7B | 37.95 |
| 4 | Llama 2 13B | 35.02 |
| 5 | Llama 3 70B Chat | 34.81 |
| 6 | GPT-4 Base | 34.42 |
| 7 | GPT-4 Preview (0125) | 34.09 |
| 8 | Claude 3 Opus | 33.64 |
| 9 | Claude Instant 1.2 | 30.27 |
| 10 | Claude 3 Sonnet | 30.18 |
| 11 | GPT-4o | 29.64 |
| 12 | O1 Preview (2024-09-12) | 27.93 |
| 13 | Claude 3 Haiku | 27.6 |
| 14 | O1 Mini (2024-09-12) | 26.58 |
| 15 | Claude 2.1 | 26.01 |
Interactive version: theaggregate.ai/benchmark?slug=sad-introspection · How It Works · Data refreshed daily, snapshot 2026-09-19.