SWE-bench Live Full (SWE-agent): leaderboard
SWE-bench-Live (Microsoft, 2025) turns recent GitHub issues into runnable tasks with its automated RepoLaunch pipeline, and a patch counts only when the repository's tests pass. This board is the Full split as first released (1,319 Python tasks from issues opened since 2024 in 93 repositories) under the SWE-agent harness, scored as the percentage of tasks resolved; higher is better.
Metric: Resolved rate (%). Source: swe-bench-live.github.io. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 | 18.57 | #492 |
| 2 | Claude 3.7 Sonnet (20250219) | 17.13 | #399 |
| 3 | GPT-4o (2024-11-20) | 9.1 | #864 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=swe-bench-live-full-swe-agent · How It Works · Data refreshed daily, snapshot 2026-11-12.