ScratchWorld - Compute: leaderboard
Compute tasks from ScratchWorld (Zhang et al., 2026): use Scratch blocks to solve algorithmic and mathematical problems, checked by unit tests run in the Scratch VM. Composite mode, where the agent reads the program as pseudocode and edits it through semantic commands such as adding or connecting blocks instead of the GUI. The score is the percentage of the 25 tasks on which every unit test passes; higher is better.
Metric: Success Rate (%). Source: huggingface.co. Saturation forecast: Around January 2027. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 68 | #142 |
| 2 | Gemini 2.5 Pro | 56 | #152 |
| 3 | GPT-5 | 44 | #98 |
| 4 | DeepSeek V3.2 | 36 | #205 |
| 5 | Qwen 2.5 Coder 7B Instruct | 0 | #951 |
| 6 | Qwen 3 Coder 30B A3B Instruct | 0 | #415 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=scratchworld-compute · How It Works · Data refreshed daily, snapshot 2026-10-20.