DeskCraft (Interactive): leaderboard
Metric: Task success rate (%) on the 152-task interactive human-in-the-loop split; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 18 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.4 | 27.6 |
| 2 | Kimi K2.6 | 25.7 |
| 3 | Kimi K2.5 | 24 |
| 4 | Qwen 3.5 35B A3B | 12.4 |
| 5 | Qwen 3.5 397B A17B | 11.7 |
| 6 | Qwen 3.6 35B A3B | 6.9 |
| 7 | Qwen 3 VL 32B | 6.9 |
| 8 | Qwen 3 VL 235B A22B | 6.2 |
| 9 | Qwen 3.5 9B | 4.2 |
| 10 | uitars-1.5-7B | 0 |
Interactive version: theaggregate.ai/benchmark?slug=deskcraft-interactive · How It Works · Data refreshed daily, snapshot 2026-09-29.