UXBench (Mobile) - Popup Without Close: leaderboard

Metric: Accuracy (0-100) on popups without an explicit close control (efficiency): two- or three-option multiple-choice UX-defect diagnosis questions on real mobile app screenshots (2,000 questions over eight tasks, balanced positive and negative cases), temperature 0, 8,192-token output limit, a response that cannot be parsed counts as wrong; printed as a 0-1 accuracy and x100 here; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 14 models tracked.

Top models

#ModelScore
1Qwen 3 VL 235B A22B (Thinking)82
2Qwen 3 VL 235B A22B Instruct79
3Claude 3.7 Sonnet78
4Claude Sonnet 4.577
5Claude Sonnet 477
6Qwen 3 VL 4B (Thinking)72
7Qwen 2.5 VL 72B Instruct70
8GLM-4.1V-9B (Thinking)62

Interactive version: theaggregate.ai/benchmark?slug=uxbench-mobile-popup-without-close · How It Works · Data refreshed daily, snapshot 2026-09-29.