ScaleWoB - Tasks With Return Values: leaderboard
The 46 ScaleWoB tasks that also require the agent to return a JSON object matching a given schema, checked programmatically together with the final app state. ScaleWoB (Liu et al., Tsinghua University and Xiaomi, 2026) runs mobile GUI agents on 120 manually verified tasks in 63 web-built replicas of real apps that coding agents synthesized; agents see only screenshots, have at most 100 steps, and results are averaged over two runs. Success rate in percent; higher is better.
Metric: Success rate (%; programmatic check of the final app state and of a schema-valid JSON answer; 46 tasks, mean of two runs). Source: arxiv.org. Saturation forecast: Around November 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Pro (Preview) | 28.26 | #111 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=scalewob-tasks-with-return-values · How It Works · Data refreshed daily, snapshot 2026-11-12.