CLI-Advantage Suite (GUI Agents): leaderboard
Metric: Success rate (%; 45 task templates x 3 seeds = 135 instances, rule-based verifier on the final device state or reported answer; mean of three seeds, weighted by task); screenshot-based GUI agents. Source: arxiv.org. Saturation forecast: Around July 2027. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | MAI-UI-8B | 27.4 |
| 2 | Qwen 3 VL 32B Instruct | 22.2 |
Interactive version: theaggregate.ai/benchmark?slug=cli-advantage-suite-gui-agents · How It Works · Data refreshed daily, snapshot 2026-09-26.