OmniGUI: leaderboard
Metric: Exact match (%): share of steps whose predicted action type and parameters (tap point inside the target element, exact typed text) both match the expert action, over all steps of OmniGUI (709 expert-demonstrated smartphone episodes, 2,579 action steps in 29 Chinese and English apps; at every step the agent receives the screenshot, a synchronous audio track and a video clip with the ground-truth action history), step-level teacher forcing, temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Pro | 63.6 |
| 2 | Gemini 3 Flash | 61.3 |
| 3 | Gemini 2.5 Pro | 44.1 |
| 4 | Gemini 2.5 Flash | 37.8 |
Interactive version: theaggregate.ai/benchmark?slug=omnigui · How It Works · Data refreshed daily, snapshot 2026-10-07.