Code2Video-Compass - V2V - TQ: leaderboard

Code2Video-Compass (2026):347fixed V2Vtasks;15models generate code in one API call with provider-default reasoning, no execution feedback or repair. Failures score zero on quality metrics. V2V GPT/Claude receive4FPSframes, others native video at4FPS. Execution, image/video similarity and Gemini3.8Flash rubric scores remain separate; runtime tokens and average ranks omitted. Published TQ Score.

Metric: Published TQ Score. Source: arxiv.org. Saturation forecast: Around February 2028. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 5.50.12#11
2Claude Opus 5.50.12#4
3GPT-6 Luna0.11#59
4MiMo-V2.6-Pro0.11#38
5GPT-6 Astra0.11#6
6GPT-6.1 Sol0.11#7
7Claude Haiku 5.50.11#40
8Gemini 3.8 Flash0.1#24
9DeepSeek V4.1 Flash0.1#35
10GLM-5.3 Flash0.09#71
11Kimi K30.09#30
12Qwen 3.8 27B0.08#111
13Qwen 3.8 Flash0.08#55
14Qwen 3.8 Max0.08#31
15MiniMax-M30.07#142

No result here: #8 Gemini 4 Argon, #9 Claude Fable 5.1, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=code2video-compass-v2v-tq · How It Works · Data refreshed daily, snapshot 2026-10-22.