LoopsBench - Claude Code Loop - Resolve Rate: leaderboard

LoopsBench (arXiv 2608.00267v2, Table 2 model sweep): eight models from different vendors on 112 dependency-structured long-horizon coding tasks, all run in the Claude Code loop. Share of tasks where every released test, regression obligations included, passes at task end after outer-loop continuation rounds on the preserved workspace; percent, higher is better.

Metric: Resolve rate (%; with outer-loop continuation). Source: arxiv.org. Saturation forecast: Around January 2028. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.725#51
2GPT-5.520.54#33
3DeepSeek V4 Pro18.75#112
4GLM-5.118.75#109
5Gemini 3.1 Pro (Preview)14.29#64
6Qwen 3.6 Plus9.82#124
7Kimi K2.66.25#113
8Grok 4.1 Fast (Reasoning)4.46#227 (Grok 4.1 Fast)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=loopsbench-claude-code-loop-resolve-rate · How It Works · Data refreshed daily, snapshot 2026-11-05.