AutoRLBench 38 Issue / 19 Solution: leaderboard
Metric: Pass rate over 38 issue judgments and 19 solution runs (%). Source: thinking-space.github.io. Saturation forecast: Around April 2028. 9 models tracked. Updated 18 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Astra | Max | 33.3 | #7 |
| 2 | GPT-6.1 Sol | Max | 33.3 | #12 |
| 3 | GLM-5.3 | Max | 26.3 | #72 |
| 4 | Kimi K3.1 Pro | Max | 22.8 | #32 |
| 5 | Claude Fable 5.1 | Max | 19.3 | #17 |
| 6 | Qwen 3.8 Max | Max | 19.3 | #63 |
| 7 | Grok 4.7 | Max | 17.5 | #48 |
| 8 | Kimi K3 | Max | 7 | #60 |
| 9 | DeepSeek V4 Pro | Max | 3.5 | #194 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=autorlbench-38-issue-19-solution · How It Works · Data refreshed daily, snapshot 2026-11-18.