iOSWorld (Vision+XML): leaderboard

iOSWorld is a mobile GUI-agent benchmark of 133 tasks across 26 purpose-built iOS apps sharing one user identity, spanning single-app, multi-app and long-horizon memory tasks. This board reports Task pass rate (%) over all 133 tasks with the accessibility tree added to vision (vision+XML), GPT-5.4-Mini judge, 50-step budget; higher is better.

Metric: Task pass rate (%) over all 133 tasks with the accessibility tree added to vision (vision+XML), GPT-5.4-Mini judge, 50-step budget; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.651.9#102
2Claude Sonnet 4.646.6#161
3GPT-5.439.8#123
4Gemini 3 Flash28.6#164
5GPT-5.4 Mini15.8#389
6Qwen 3.5 35B A3B10.5#482

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=iosworld-vision-plusxml · How It Works · Data refreshed daily, snapshot 2026-11-13.