Code2Video-Compass - I2V - TQ: leaderboard

Code2Video-Compass (2026):347fixed I2Vtasks;15models generate code in one API call with provider-default reasoning, no execution feedback or repair. Failures score zero on quality metrics. V2V GPT/Claude receive4FPSframes, others native video at4FPS. Execution, image/video similarity and Gemini3.8Flash rubric scores remain separate; runtime tokens and average ranks omitted. Published TQ Score.

Metric: Published TQ Score. Source: arxiv.org. Saturation forecast: Around January 2028. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 5.50.11#11
2Claude Opus 5.50.11#4
3GPT-6 Astra0.11#6
4Claude Haiku 5.50.11#40
5GPT-6.1 Sol0.11#7
6GPT-6 Luna0.11#59
7MiMo-V2.6-Pro0.11#38
8Gemini 3.8 Flash0.1#24
9Kimi K30.1#30
10DeepSeek V4.1 Flash0.1#35
11GLM-5.3 Flash0.09#71
12Qwen 3.8 Flash0.09#55
13Qwen 3.8 27B0.08#111
14Qwen 3.8 Max0.07#31
15MiniMax-M30.06#142

No result here: #8 Gemini 4 Argon, #9 Claude Fable 5.1, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=code2video-compass-i2v-tq · How It Works · Data refreshed daily, snapshot 2026-10-22.