DeepSWE-mini (16 Tasks): leaderboard
Metric: Pass@1 (%, 16-task subset). Source: huggingface.co. 31 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-6 (xHigh) | 81.25 |
| 2 | GPT-6 | 79.69 |
| 3 | GPT-5.6 Sol | 78.12 |
| 4 | Claude Opus 5 | 75 |
| 5 | Gemini 3 Flash | 75 |
| 6 | Kimi K3 | 70.31 |
| 7 | GPT-5.5 (xHigh) | 70.31 |
| 8 | GLM-5.3 | 70.31 |
| 9 | Grok 4.6 | 70.31 |
| 10 | GPT-5.6 Sol (xHigh) | 70.31 |
| 11 | Claude Fable 5 | 67.71 |
| 12 | GLM-5.3 Flash | 66.15 |
| 13 | GPT-5.5 | 65.62 |
| 14 | DeepSeek V4 Pro | 59.38 |
| 15 | Claude Opus 4.8 | 55 |
Interactive version: theaggregate.ai/benchmark?slug=deepswe-mini-16-tasks · How It Works · Data refreshed daily, snapshot 2026-09-20.