SWE-Chain: leaderboard
Metric: F1-score (%; 2TP / (2TP + FP + FN) over each chain's release steps, where TP are upgrade-related tests resolved, FN those left failing and FP previously passing tests broken, averaged over 12 chains; Build+Fix regime with one fix attempt for execution-level errors). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.5 (Codex, xHigh) | 64.8 |
Interactive version: theaggregate.ai/benchmark?slug=swe-chain · How It Works · Data refreshed daily, snapshot 2026-09-26.