DeskCraft (Interactive): leaderboard
DeskCraft is an execution-based desktop GUI-agent benchmark of 538 professional-software tasks (386 standard, 152 interactive) across eleven applications, verified from the resulting desktop state. This board reports Task success rate (%) on the 152-task interactive human-in-the-loop split; higher is better.
Metric: Task success rate (%) on the 152-task interactive human-in-the-loop split; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 18 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.4 | 27.6 | #123 |
| 2 | Kimi K2.6 | 25.7 | #178 |
| 3 | Kimi K2.5 | 24 | #256 |
| 4 | Qwen 3.5 35B A3B | 12.4 | #482 |
| 5 | Qwen 3.5 397B A17B | 11.7 | #246 |
| 6 | Qwen 3.6 35B A3B | 6.9 | #462 |
| 7 | Qwen 3 VL 235B A22B | 6.2 | #479 |
| 8 | Qwen 3.5 9B | 4.2 | #803 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=deskcraft-interactive · How It Works · Data refreshed daily, snapshot 2026-11-13.