VideoVIBE - Rendering Availability: leaderboard

Metric: Failure-diagnosis accuracy (%; questions of the Rendering Availability subdimension of Functional Executability; zero-shot single-choice diagnosis from the interaction video and the page source code (Video+HTML), about 1.7K questions built from 6,338 verified failures of one-shot generated web applications recorded under human operation; free-form answers mapped deterministically to an option). Source: arxiv.org. Saturation forecast: Around February 2027. 13 models tracked.

Top models

#ModelScore
1Gemini 3 Flash64.86
2Gemini 3.1 Pro (Preview)59.46
3Qwen 3.5 35B A3B54.05
4Gemini 2.5 Flash45.95
5GLM-4.6V43.24
6Qwen 3 VL 8B (Thinking)40.54
7Qwen 3 VL 30B A3B (Thinking)40.54
8Gemini 3.1 Flash Lite35.14
9MiMo-V2.535.14
10Qwen 3 VL 30B A3B Instruct35.14
11Qwen 3 VL 8B Instruct24.32

Interactive version: theaggregate.ai/benchmark?slug=videovibe-rendering-availability · How It Works · Data refreshed daily, snapshot 2026-09-29.