VideoVIBE - Layout Integrity: leaderboard

Metric: Failure-diagnosis accuracy (%; questions of the Layout Integrity subdimension of Structural and Temporal Coherence; zero-shot single-choice diagnosis from the interaction video and the page source code (Video+HTML), about 1.7K questions built from 6,338 verified failures of one-shot generated web applications recorded under human operation; free-form answers mapped deterministically to an option). Source: arxiv.org. Saturation forecast: Around May 2028. 13 models tracked.

Top models

#ModelScore
1Qwen 3 VL 30B A3B (Thinking)82.8
2Qwen 3 VL 8B (Thinking)78.98
3Gemini 3.1 Pro (Preview)77.07
4Gemini 3.1 Flash Lite71.97
5Qwen 3 VL 30B A3B Instruct71.97
6Gemini 2.5 Flash68.15
7GLM-4.6V66.88
8Qwen 3.5 35B A3B63.69
9MiMo-V2.561.15
10Qwen 3 VL 8B Instruct50.32
11Gemini 3 Flash41.4

Interactive version: theaggregate.ai/benchmark?slug=videovibe-layout-integrity · How It Works · Data refreshed daily, snapshot 2026-09-29.