VG-GUI-Bench (10 Uniform Frames): leaderboard
Video-guided mobile GUI agents on VG-GUI-Bench (Fan, Liu, Yin, Guo and Yang, ECCV 2026): for each of the 1,071 steps of 100 tutorial-paired episodes built on MONDAY, the model predicts the next tap, swipe, text entry, key press, zoom or finish from the task, its action history and the current screen. It also sees ten frames sampled uniformly from the tutorial video. Step accuracy in percent gives 0.3 for the right action type and up to 0.7 more for its arguments; higher is better.
Metric: Step accuracy (%; 0.3 for the right action type plus up to 0.7 for its arguments, over the 1,071 steps of 100 mobile GUI episodes; ten uniformly sampled tutorial frames). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 61.68 | #91 |
| 2 | GPT-5 Mini | 58.4 | #349 |
| 3 | Kimi K2.5 | 58.22 | #252 |
| 4 | Claude Sonnet 4.6 | 45.8 | #158 |
| 5 | Seed 2.0 Pro | 39.78 | #209 |
| 6 | Qwen 3 VL 235B A22B | 26.88 | #477 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=vg-gui-bench-10-uniform-frames · How It Works · Data refreshed daily, snapshot 2026-11-12.