GMA - Realistic: leaderboard
Metric: Success rate (%; 300 tasks in seven custom Android applications, vision-only agent seeing raw screenshots (two most recent kept), MobileWorld action space plus call_user and answer, Qwen3.7-Plus user simulator, 150-step budget; 20 realistic underspecified workflows over four to seven applications with distractors). Source: arxiv.org. Saturation forecast: Around 2029. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Seed 2.1 Pro | 20 |
| 2 | Claude Opus 4.7 | 15 |
| 3 | GPT-5.6 Sol | 10 |
| 4 | Qwen 3.8 Max | 10 |
| 5 | Claude Sonnet 4.6 | 0 |
| 6 | GPT-5.5 | 0 |
| 7 | Gemini 3.5 Flash | 0 |
| 8 | Qwen 3.7 Plus | 0 |
Interactive version: theaggregate.ai/benchmark?slug=gma-realistic · How It Works · Data refreshed daily, snapshot 2026-09-29.