OSCBench - Novel Scenarios: leaderboard
Metric: Object state change score (mean of accuracy and consistency) on OSCBench's 20 novel scenarios (unusual action-object pairs), human ratings (three raters, 1-5 Likert, printed on a 0-1 scale, x100), one generated video per scenario; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Veo-3.1-Fast | 73.1 | |
| 2 | Kling 2.5 Turbo | 71.4 | |
| 3 | HunyuanVideo-1.5 | 55.9 | |
| 4 | Wan2.2 | 53.1 | |
| 5 | HunyuanVideo | 40.5 | |
| 6 | Open-Sora-2.0 | 38.9 |
Interactive version: theaggregate.ai/benchmark?slug=oscbench-novel-scenarios · How It Works · Data refreshed daily, snapshot 2026-10-11.