SWE-Serve: leaderboard
Metric: pass@1 (%; mean over three runs of the fraction of the 53 tasks whose agent patch passes every hidden functional, regression, E2E and performance test; mini-SWE-agent harness, closed-book). Source: arxiv.org. Saturation forecast: Around June 2027. 31 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.6 Sol (Max) | 75.5 |
| 2 | Claude Opus 5 (Max) | 75.5 |
| 3 | Claude Opus 5 (High) | 73.6 |
| 4 | Claude Opus 5 (xHigh) | 72.3 |
| 5 | Claude Opus 5 (Medium) | 68.6 |
| 6 | GPT-5.6 Sol (xHigh) | 66 |
| 7 | Kimi K3 (Max) | 64.2 |
| 8 | GPT-5.6 Luna (Max) | 64.2 |
| 9 | GPT-5.6 Terra (Max) | 64.2 |
| 10 | Claude Sonnet 5 (xHigh) | 64.2 |
| 11 | Claude Sonnet 5 (Max) | 61 |
| 12 | Claude Opus 5 (Low) | 60.4 |
| 13 | Claude Sonnet 5 (High) | 57.9 |
| 14 | GPT-5.6 Sol (High) | 56 |
| 15 | GPT-5.6 Luna (xHigh) | 55.3 |
Interactive version: theaggregate.ai/benchmark?slug=swe-serve · How It Works · Data refreshed daily, snapshot 2026-09-26.