VideoVIBE - Navigation Mapping: leaderboard

The Navigation Mapping subdimension (structural and temporal coherence) of VideoVIBE (2026): video MLLMs diagnose which failure a recorded session of a one-shot generated website shows, from the video and page source. Accuracy in percent; higher is better.

Metric: Failure-diagnosis accuracy (%; questions of the Navigation Mapping subdimension of Structural and Temporal Coherence; zero-shot single-choice diagnosis from the interaction video and the page source code (Video+HTML), about 1.7K questions built from 6,338 verified failures of one-shot generated web applications recorded under human operation; free-form answers mapped deterministically to an option). Source: arxiv.org. Saturation forecast: Not forecast. 13 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 35B A3B51.22#482
2Gemini 2.5 Flash48.78#453
3Qwen 3 VL 30B A3B (Thinking)46.34#712
4Qwen 3 VL 8B (Thinking)43.9#887
5MiMo-V2.536.59#354
6Gemini 3.1 Pro (Preview)34.15#94
7Qwen 3 VL 8B Instruct31.71#981
8Gemini 3.1 Flash Lite31.71#364
9GLM-4.6V31.71#701
10Qwen 3 VL 30B A3B Instruct26.83#871
11Gemini 3 Flash14.63#164

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=videovibe-navigation-mapping · How It Works · Data refreshed daily, snapshot 2026-11-13.