DSGym - DABStep Hard: leaderboard
Metric: Exact-Match Accuracy (%). Source: arxiv.org. Saturation forecast: Around April 2027. 13 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.5 | 37.04 |
| 2 | Claude Sonnet 4 | 31.75 |
| 3 | Kimi K2 0905 | 28.84 |
| 4 | GPT-5 (Medium) | 28.31 |
| 5 | DeepSeek V3.1 | 21.96 |
| 6 | GPT-5.1 (High) | 13.23 |
| 7 | GPT-5.1 (Non-reasoning) | 11.9 |
| 8 | GPT-OSS-120B | 7.94 |
| 9 | GPT-4o (2024-08-06) | 7.41 |
| 10 | Qwen 3 4B Instruct | 2.9 |
| 11 | Qwen 2.5 7B Instruct | 2.38 |
Interactive version: theaggregate.ai/benchmark?slug=dsgym-dabstep-hard · How It Works · Data refreshed daily, snapshot 2026-09-25.