AutoRLBench 45 Issue / 19 Solution: leaderboard

Thinking-Space AutoRLBench 45-issue / 19-solution edition (commit b3389eac) evaluating autonomous RL research agents across 64 tasks (45 issue diagnosis and 19 solution implementation tasks) in sandboxed repositories; overall pass rate (%).

Metric: Pass rate over 45 issue judgments and 19 solution runs (%). Source: thinking-space.github.io. Saturation forecast: Around 2030. 9 models tracked. Updated 21 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1DeepSeek V4.1 FlashMax29.7#67
2GPT-6.1 SolMax28.1#15
3GLM-5.3Max28.1#72
4GPT-6 AstraMax26.6#10
5Qwen 3.8 MaxMax23.4#63
6Grok 4.7Max21.9#51
7Claude Fable 5.1Max20.3#20
8Kimi K3.1 ProMax17.2#36
9Kimi K3Max7.8#61

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=autorlbench-45-issue-19-solution · How It Works · Data refreshed daily, snapshot 2026-11-21.