HypoArena - IT Operations: leaderboard
Metric: Rating on the 146 IT operations cases: Bradley-Terry-Davidson rating (base 1500, open-ended) from reference-independent pairwise judgments by seed-2.0-pro, both presentation orders, with the source-derived reference hypothesis set as an anonymous competitor; baseline single-pass generation; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 15 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.6 (High) | 1699.8 |
| 2 | Claude Opus 4.6 (High) | 1678.3 |
| 3 | GPT-5.4 (High) | 1641.2 |
| 4 | GLM-5.1 | 1588.3 |
| 5 | Kimi K2.6 | 1569.1 |
| 6 | DeepSeek V4 Pro (High) | 1517.5 |
| 7 | MiniMax-M2.7 | 1516.1 |
| 8 | GLM-5 | 1483.5 |
| 9 | MiniMax-M2.5 | 1433.4 |
| 10 | DeepSeek V4 Flash (High) | 1424.6 |
| 11 | GPT-5.4 Mini (High) | 1397.7 |
| 12 | Gemini 3.1 Pro (Preview) (High) | 1388.2 |
| 13 | Kimi K2.5 (Thinking) | 1330.3 |
| 14 | Gemini 3 Flash (High) | 1301 |
Interactive version: theaggregate.ai/benchmark?slug=hypoarena-it-operations · How It Works · Data refreshed daily, snapshot 2026-09-29.