Active-SWE - Revealed: leaderboard

Active-SWE revealed potential bugs: the percentage of tasks where every potential bug the agent reports is backed by a valid fail-to-pass test, building on test validity (arXiv 2608.04682v1). 0-100, higher is better. Every model ran in the Claude Code harness; from the project site's data/site-data.json (full 400-task main set).

Metric: Potential Bugs Revealed (%). Source: hbinli.github.io. Saturation forecast: Around February 2027. 18 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.875#39
2GLM-5.269#80
3GPT-5.565.5#33
4Qwen 3.7 Max59.8#85
5Hy358.5#100
6Gemini 3.1 Pro (Preview)57#64
7Ring-2.6-1T56.3#176
8Claude Sonnet 4.653.8#94
9DeepSeek V4 Pro53.3#112
10Kimi K2.651.8#113
11Kimi K2.7 Code47.8#95
12Qwen 3.5 397B A17B42#154
13Qwen 3.5 122B A10B40#184
14Ling-3.0-flash38.75#215
15MiniMax-M2.738.5#270

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=active-swe-revealed · How It Works · Data refreshed daily, snapshot 2026-11-05.