SWE-Cycle - Test Generation Solve Rate: leaderboard
SWE-Cycle Test Generation Solve Rate is the percent of 489 filtered SWE-bench issues where a code agent completes the isolated task to write tests that isolate the issue in a patched codebase with full marks on both static review and execution (SWE-Cycle, 2026). Higher is better.
Metric: Solve rate (%): share of issues with a perfect score (full marks on both static and dynamic checks by SWE-Judge (Claude Opus 4.5 agent) static code review and dynamic execution, each scored 0, 1 or 2), on the 489 SWE-Cycle issues (225 SWE-bench Verified, 203 SWE-bench Pro, 61 SWE-bench Multilingual, filtered for contamination, lifecycle complexity and reliable tests); isolated TestGen: write tests that isolate the issue in a patched codebase (90 minutes); agents run in the OpenCode harness in isolated Docker containers; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 67.28 | #173 |
| 2 | GLM-5.1 | 60.53 | #198 |
| 3 | Kimi K2.5 | 52.07 | #266 |
| 4 | SWE-Cycle Qwen-3.5 (checkpoint unspecified) | 46.01 | |
| 5 | GPT-5.4 | 42.13 | #135 |
| 6 | MiniMax-M2.7 | 33.33 | #539 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=swe-cycle-test-generation-solve-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.