Phi-Bench - I/O: leaderboard
Phi-Bench evaluates agents implementing and optimizing AI infrastructure, including kernels, serving, compression and system engineering. Scores combine correctness and performance under the paper's shared harness; task formats stay separate. This series reports Phi-Bench - I/O from 2609.10226v1, Sx3.T2: Infrastructure Score (%). Higher is better.
Metric: Infrastructure Score (%). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 57.1 | #15 |
| 2 | GPT-5.6 Sol | 38.5 | #22 |
| 3 | Kimi K3 | 35.7 | #36 |
| 4 | Claude Sonnet 5 | 20.6 | #67 |
| 5 | GLM-5.2 | 19.1 | #82 |
| 6 | Qwen 3.8 Max | 18.3 | #35 |
| 7 | Qwen 3.7 Max | 17.4 | #88 |
| 8 | DeepSeek V4 Pro | 3.7 | #113 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=phi-bench-i-o · How It Works · Data refreshed daily, snapshot 2026-11-07.