SWE-Cycle - Environment Reconstruction Solve Rate: leaderboard
Metric: Solve rate (%): share of issues with a perfect score (full marks on both static and dynamic checks by SWE-Judge (Claude Opus 4.5 agent) static code review and dynamic execution, each scored 0, 1 or 2), on the 489 SWE-Cycle issues (225 SWE-bench Verified, 203 SWE-bench Pro, 61 SWE-bench Multilingual, filtered for contamination, lifecycle complexity and reliable tests); isolated Env: from source code only, build the execution environment and resolve dependencies (90 minutes); agents run in the OpenCode harness in isolated Docker containers; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.6 | 78.12 |
| 2 | GLM-5.1 | 73.01 |
| 3 | GPT-5.4 | 71.78 |
| 4 | Kimi K2.5 | 61.34 |
| 5 | MiniMax-M2.7 | 45.4 |
Interactive version: theaggregate.ai/benchmark?slug=swe-cycle-environment-reconstruction-solve-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.