AndroidDaily - 3+ Constraints: leaderboard

Metric: Task success rate (%) on tasks with three or more constraints, 350 tasks in 94 real closed-source Android apps, end-to-end sessions judged by the GRADE evaluator (Gemini 3 Pro backbone, 87.37 percent agreement with human review) against three-tier task guidelines; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 12 models tracked.

Top models

#ModelScore
1Gemini 3 Flash58
2Gemini 3 Pro50
3Seed 2.0 Pro39.8
4Seed 1.839.4
5GLM-4.6V27.4
6MAI-UI-8B6.6

Interactive version: theaggregate.ai/benchmark?slug=androiddaily-3-plus-constraints · How It Works · Data refreshed daily, snapshot 2026-10-07.