MSVBench (Human Rating) - Video Consistency: leaderboard
Metric: Mean opinion score (1 to 5) for consistency of characters, clothing, backgrounds and scale across shots (MSVBench human rating: 10 annotators with animation backgrounds rate each system's multi-shot storytelling videos generated from the MSVBench scripts (20 stories adapted from ViStoryBench, with character and shot reference images) on a 1-to-5 scale); higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Veo3.1 | 3.68 | |
| 2 | Sora2 | 3.56 | |
| 3 | LTXV-13B-0.9.8 | 3.06 | |
| 4 | AniSora3.2 | 3.03 | |
| 5 | Wan2.2-I2V-A14B | 2.86 | |
| 6 | HunyuanVideo-I2V | 2.82 | |
| 7 | LongLive | 2.69 | |
| 8 | Wan2.2-TI2V-5B | 2.67 | |
| 9 | CogVideoX1.5-5B-I2V | 2.48 | |
| 10 | Self-Forcing | 2.36 |
Interactive version: theaggregate.ai/benchmark?slug=msvbench-human-rating-video-consistency · How It Works · Data refreshed daily, snapshot 2026-10-11.