RoadmapBench: leaderboard

Coding agents are increasingly deployed in real software development, where a single version iteration requires months of coordinated work across many files. However, most existing benchmarks focus predominantly on single-issue bug fixes from Python repositories, with coarse pass/fail evaluation outcomes, and thus fail to capture long-horizon, multi-target development at real engineering scale. To

Metric: Resolved (%) (self-reported). Source: benchmarklist.com. Saturation forecast: Around July 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.739.1#49
2Claude Opus 4.632.2#63
3GPT-5.429.6#79
4Gemini 3.1 Pro (Preview)20.9#58
5GLM-5.120.9#97
6DeepSeek V4 Pro18.3#102
7Qwen 3.6 Plus16.5#120
8Kimi K2.615.7#104
9MiMo-V2.5-Pro13.9#158
10Kimi K2.511.3#144
11Qwen 3.5 397B A17B10.4#146
12MiniMax-M2.710.4#258
13Seed 2.0 Pro5.2#118

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=roadmapbench · How It Works · Data refreshed daily, snapshot 2026-10-20.