LoopsBench - Vendor Loops - Resolve Rate (Single Segment): leaderboard
LoopsBench (arXiv 2608.00267v2, Table 2 within-family panel): 12 models on 112 dependency-structured long-horizon coding tasks, each run in its vendor's loop (GPT in Codex, Claude in Claude Code, Qwen in Qwen Code). Share of tasks where every released test, regression obligations included, passes before any outer-loop continuation; percent, higher is better.
Metric: Resolve rate (%; without outer-loop continuation). Source: arxiv.org. Saturation forecast: Around December 2027. 12 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.7 | 16.96 | #51 |
| 2 | GPT-5.5 | 14.29 | #33 |
| 3 | Claude Opus 4.5 | 12.5 | #87 |
| 4 | GPT-5.2 | 9.82 | #115 |
| 5 | Claude Sonnet 4.5 | 8.93 | #148 |
| 6 | Qwen 3.6 Plus | 6.25 | #124 |
| 7 | GPT-5 | 5.36 | #105 |
| 8 | Qwen 3.5 Plus | 5.36 | #133 |
| 9 | Claude Sonnet 4 | 4.46 | #207 |
| 10 | GPT-4o | 1.79 | #357 |
| 11 | Qwen 3 Max | 0.89 | #213 |
| 12 | Qwen 2.5 72B | 0 | #512 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=loopsbench-vendor-loops-resolve-rate-single-segment · How It Works · Data refreshed daily, snapshot 2026-11-05.