MobiFlow - Action Match Rate: leaderboard

Metric: Action match rate (%) in the instruction-following scenario, the share of the task's step instructions the agent's actions satisfy on MobiFlow's 240 real-world tasks in 20 third-party Android apps, scored on task-completion state graphs fused from real trajectories, at most 50 steps; general models in the paper's shared execution framework (OmniParser marks actionable elements; OpenRouter, temperature 0); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.

Top models

#ModelScore
1GPT-571.4
2Claude Opus 4.162.2
3Gemini 3 Flash56.4
4Gemini 2.5 Pro55.3
5Gemini 2.5 Flash35.5
6Grok 44.1

Interactive version: theaggregate.ai/benchmark?slug=mobiflow-action-match-rate · How It Works · Data refreshed daily, snapshot 2026-10-07.