Code2Video-Compass - V2V - AF: leaderboard

Code2Video-Compass (2026):347fixed V2Vtasks;15models generate code in one API call with provider-default reasoning, no execution feedback or repair. Failures score zero on quality metrics. V2V GPT/Claude receive4FPSframes, others native video at4FPS. Execution, image/video similarity and Gemini3.8Flash rubric scores remain separate; runtime tokens and average ranks omitted. Published AF Score.

Metric: Published AF Score. Source: arxiv.org. Saturation forecast: Around January 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.50.79#4
2Claude Sonnet 5.50.77#11
3GPT-6 Astra0.73#6
4GPT-6.1 Sol0.71#7
5Claude Haiku 5.50.67#40
6GPT-6 Luna0.66#59
7Gemini 3.8 Flash0.64#24
8MiMo-V2.6-Pro0.62#38
9DeepSeek V4.1 Flash0.6#35
10GLM-5.3 Flash0.57#71
11Qwen 3.8 Max0.53#31
12Kimi K30.51#30
13Qwen 3.8 27B0.51#111
14Qwen 3.8 Flash0.5#55
15MiniMax-M30.41#142

No result here: #8 Gemini 4 Argon, #9 Claude Fable 5.1, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=code2video-compass-v2v-af · How It Works · Data refreshed daily, snapshot 2026-10-22.