SlopCodeBench (Just Solve) - Isolated: leaderboard
Metric: Isolated solve rate (%): share of the 196 checkpoints whose workspace passes all of that checkpoint's own tests, ignoring regression tests, on SlopCodeBench's 36 iterative problems (196 checkpoints): the agent extends its own prior code as the CLI or API specification evolves, with hidden tests, run in the model's native coding harness (the harness and reasoning level are in the label), using the plain task prompt; higher is better. Source: arxiv.org. Saturation forecast: Around January 2028. 19 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.5 (High) | 28.1 | #26 (GPT-5.5) |
| 2 | GPT-5.3 Codex (High) | 26 | #68 (GPT-5.3 Codex) |
| 3 | GPT-5.4 (High) | 23.5 | #76 (GPT-5.4) |
| 4 | GPT-5.2 Codex (High) | 21.9 | #89 (GPT-5.2 Codex) |
| 5 | Claude Opus 4.6 (High) | 20.9 | #60 (Claude Opus 4.6) |
| 6 | Claude Opus 4.7 (High) | 20.9 | #45 (Claude Opus 4.7) |
| 7 | Claude Opus 4.5 (High) | 17.3 | #79 (Claude Opus 4.5) |
| 8 | Claude Sonnet 4.6 (High) | 16.8 | #85 (Claude Sonnet 4.6) |
| 9 | GPT-5.4 Mini (High) | 13.8 | #202 (GPT-5.4 Mini) |
| 10 | Kimi K2.5 | 8.7 | #139 |
| 11 | Kimi K2.5 (High) | 7.1 | #139 (Kimi K2.5) |
| 12 | MiniMax-M2.7 | 3.6 | #248 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=slopcodebench-just-solve-isolated · How It Works · Data refreshed daily, snapshot 2026-10-11.