EvoGUI-Bench - Inverse Action and Value: leaderboard

The inverse probe of EvoGUI-Bench (Tsinghua University, 2026): from two consecutive web screenshots, predict the click, type or select action that caused the change and its typed or selected value. Joint accuracy in percent; higher is better.

Metric: Joint action and value accuracy (%; share of 1,000 consecutive screenshot pairs for which the model predicts both the click, type or select action and its typed or selected value; on EvoGUI-Bench, 3,000 zero-shot visual question answering probes mined from Mind2Web and WebLINX web trajectories across 120 domains, screenshots at max_image_side 512, temperature 0; higher is better). Source: arxiv.org. Saturation forecast: Around 2030. 28 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash (Preview)65.4#144
2Qwen 3.5 397B A17B56.6#246
3Qwen 3.6 35B A3B56.6#462
4Qwen 3.5 122B A10B56.4#331
5Doubao-Seed-2.0-Pro-26021555.7#152
6Qwen 3.6 27B55.1#341
7Qwen 3 VL 235B A22B Instruct55.1#522
8Qwen 3.5 27B54.8#359
9Qwen 3.5 35B A3B54.8#482
10MiMo-V2.554.5#354
11GLM-5V Turbo54#344
12Kimi K2.552.8#256
13Kimi K2.652.6#178
14GPT-5 Mini52.5#348
15GLM-4.5V52.3#744

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=evogui-bench-inverse-action-and-value · How It Works · Data refreshed daily, snapshot 2026-11-13.