WindowsWorld (Screenshot + Accessibility Tree): leaderboard
GUI agents on WindowsWorld (2026), 181 persona-driven professional tasks across 17 Windows desktop applications, mostly multi-application workflows plus infeasible tasks to reject, with the model observing screenshots plus the accessibility tree and acting through PyAutoGUI. Share of tasks whose final state is judged correct, in percent; higher is better.
Metric: Final task success rate (%) over all 181 tasks of WindowsWorld (persona-driven Windows desktop tasks across 17 applications, executed with a unified PyAutoGUI action space and level-specific step budgets of 15, 25, 40 and 20), the model observing screenshots plus the accessibility tree, states judged by a human-validated Qwen3-VL-Plus judge; infeasible Level 4 tasks count as solved when the agent correctly rejects them; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 5 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash (Preview) | 20.44 | #156 |
| 2 | Gemini 3 Pro (Preview) | 14.77 | #123 |
| 3 | Qwen 3 VL Plus | 4.97 | #514 |
| 4 | GPT-5.2 | 1.12 | #190 |
| 5 | Claude Sonnet 4.5 | 0.55 | #267 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=windowsworld-screenshot-plus-accessibility-tree · How It Works · Data refreshed daily, snapshot 2026-11-22.