CTBench - Path Restoration Accuracy: leaderboard

CTBench (arXiv 2608.12002v1, Table 5): expert-built telecom network troubleshooting tasks solved by agent harness and model pairs in a sandbox that exposes only permitted diagnostic commands. Share of path-restoration tasks answered exactly, percent. Higher is better.

Metric: Exact path-restoration answers (%). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.587.96#33
2Qwen 3.7 Max40.74#85
3DeepSeek V4 Pro26.85#112
4Qwen 3.7 Plus17.59#98

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=ctbench-path-restoration-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-05.