VibeVideoBench GPT5.6Sol and Qwen3.8OmniFlash - All Core Pass: leaderboard

VibeVideoBench v1 has 239 English/Chinese tasks across 12 categories. Each model-task pair receives one autonomous rollout in its native agent harness, using identical Ubuntu 24.04 containers with 8 CPUs, 32GB RAM, and no GPU. The 3600-second budget includes tools and rendering. The output is a code-generated MP4 with sound; Qwen3-TTS-Flash is the only generative service. Native harnesses and effort levels remain explicit, with no model-only aliases. Three blind judge panels are averaged separately: Gemini 4 Argon and Gemini 3.8 Flash evaluate full video/audio, while GPT 5.6 Sol evaluates visual frames with Qwen3.8 OmniFlash evaluating audio. L2 checks allow pass, fail, unknown, or NA; strict success requires no failed core check and at least one pass. L3 averages five anchored quality dimensions. Delivered-only populations remain separate from populations that assign zero to missing videos. This board is the individual GPT 5.6 Sol and Qwen 3.8 OmniFlash panel, not the three-panel average. All-core success counts unknown judgments against success; strict success does not. Metric: Pass rate (%).

Metric: Pass rate (%). Source: arxiv.org. Saturation forecast: Around 2029. 9 models tracked.

Top models

No result here: #2 Claude Opus 5.5, #6 GPT-6.1 Sol, #8 Gemini 4 Argon.

Interactive version: theaggregate.ai/benchmark?slug=vibevideobench-gpt5-6sol-and-qwen3-8omniflash-all-core-pass · How It Works · Data refreshed daily, snapshot 2026-10-28.