Diplomacy: Steerability — leaderboard
Metric: Steerability Score. Source: goodstartlabs.com. 22 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GLM-4.6 | 32.5 |
| 2 | GPT-5 (Minimal) | 21.9 |
| 3 | O3 | 17.17 |
| 4 | GPT-5 Mini | 12.02 |
| 5 | Llama 4 Maverick | 9.7 |
| 6 | Grok 4 Fast | 9.7 |
| 7 | GPT-5 (Medium) | 8.95 |
| 8 | GPT-OSS-120B | 8.04 |
| 9 | Hermes 4 405B | 6.35 |
| 10 | Kimi K2 | 5.85 |
| 11 | O4 Mini | 5.32 |
| 12 | Gemini 3 Pro | 5.3 |
| 13 | Grok 4 Fast (Reasoning) | 3.1 |
| 14 | Gemini 2.5 Pro | 1.85 |
| 15 | Claude Opus 4.5 | 1.6 |
Interactive version: theaggregate.ai/benchmark?slug=diplomacy-steerability · How the rankings work · Data refreshed daily, snapshot 2026-07-22.