AutoRLBench 45 Issue / 19 Solution - Issue: leaderboard

Issue-diagnosis split (45 tasks) of Thinking-Space AutoRLBench 45-issue / 19-solution edition measuring whether agents isolate and verify root causes of RL training failures; pass rate (%).

Metric: Root cause found, 45 failed training runs (%). Source: thinking-space.github.io. Saturation forecast: Not forecast. 9 models tracked. Updated 21 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1DeepSeek V4.1 FlashMax31.1#67
2GLM-5.3Max28.9#72
3GPT-6 AstraMax26.7#10
4GPT-6.1 SolMax26.7#15
5Qwen 3.8 MaxMax20#63
6Grok 4.7Max20#51
7Claude Fable 5.1Max17.8#20
8Kimi K3.1 ProMax13.3#36
9Kimi K3Max4.4#61

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=autorlbench-45-issue-19-solution-issue · How It Works · Data refreshed daily, snapshot 2026-11-21.