SWE-bench Live Verified (SWE-agent): leaderboard
SWE-bench-Live (Microsoft, 2025) turns recent GitHub issues into runnable tasks with its automated RepoLaunch pipeline, and a patch counts only when the repository's tests pass. This board is the frozen 500-task Verified split of Python tasks under the SWE-agent harness, scored as the percentage of tasks resolved; higher is better.
Metric: Resolved rate (%). Source: swe-bench-live.github.io. Saturation forecast: Around June 2027. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 40 | #244 |
| 2 | GPT-5 (Medium) | 30.4 | #163 (GPT-5) |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=swe-bench-live-verified-swe-agent · How It Works · Data refreshed daily, snapshot 2026-11-12.