AnimationBench - Semantic Consistency: leaderboard
Agreement of generated animations with the prompt and conditioning image in objects, actions, colors and scene, averaged over the four, on AnimationBench, an animation image-to-video benchmark (2026) built on IP preservation and the Twelve Basic Principles of Animation, about 30 generated videos per dimension, scored by Qwen3-VL-Max yes/no question sets. Percent; higher is better.
Metric: Semantic Consistency overall: mean of object, action, color and scene agreement with the prompt and conditioning image (the paper's Sem. Overall) (%), animation-style image-to-video generation from the AnimationBench close-set suite (fixed source images and prompts, about 30 videos per dimension per model), scored by Qwen3-VL-Max yes/no question sets aggregated per video; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Veo 3.1 | 89.31 | |
| 2 | Seedance 2.0 | 89.05 | |
| 3 | Kling 2.6 | 86.11 | |
| 4 | Seedance 1.0 Pro | 69.86 | |
| 5 | Wan2.2-I2V-A14B | 67.86 | |
| 6 | FramePack | 33.33 | |
| 7 | HunyuanVideo-1.5 | 24.2 |
Interactive version: theaggregate.ai/benchmark?slug=animationbench-semantic-consistency · How It Works · Data refreshed daily, snapshot 2026-11-21.