VideoVIBE - Navigation Mapping: leaderboard

Metric: Failure-diagnosis accuracy (%; questions of the Navigation Mapping subdimension of Structural and Temporal Coherence; zero-shot single-choice diagnosis from the interaction video and the page source code (Video+HTML), about 1.7K questions built from 6,338 verified failures of one-shot generated web applications recorded under human operation; free-form answers mapped deterministically to an option). Source: arxiv.org. Saturation forecast: Around 2033. 13 models tracked.

Top models

#ModelScore
1Qwen 3.5 35B A3B51.22
2Gemini 2.5 Flash48.78
3Qwen 3 VL 30B A3B (Thinking)46.34
4Qwen 3 VL 8B (Thinking)43.9
5MiMo-V2.536.59
6Gemini 3.1 Pro (Preview)34.15
7Qwen 3 VL 8B Instruct31.71
8Gemini 3.1 Flash Lite31.71
9GLM-4.6V31.71
10Qwen 3 VL 30B A3B Instruct26.83
11Gemini 3 Flash14.63

Interactive version: theaggregate.ai/benchmark?slug=videovibe-navigation-mapping · How It Works · Data refreshed daily, snapshot 2026-09-29.