ChronoPhyBench - Next-State Selection (6 Options): leaderboard
Metric: Accuracy (%) on ChronoPhyBench next-state frame selection with 6 candidates: given a real physical-interaction video context (8 uniformly sampled frames) and its caption, choose the frame that comes next; closed models at temperature 0.1, open models at their recommended sampling; chance 16.7; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 25 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.5 | 70.5 |
| 2 | Doubao-Seed-2.0-Pro-260215 | 65 |
| 3 | Gemini 3 Pro (Preview) | 63 |
| 4 | Doubao-Seed-1-8-251228 | 53 |
| 5 | Gemini 2.5 Pro | 46.63 |
| 6 | GLM-4.1V-9B (Thinking) | 39.5 |
| 7 | Doubao-Seed-1.6-thinking-250715 | 38.5 |
| 8 | Gemini 2.5 Flash | 37.85 |
| 9 | GPT-5.4 | 37.5 |
| 10 | GPT-5.3 | 34.5 |
| 11 | Qwen 3 VL 32B Instruct | 25.5 |
| 12 | Qwen 3 VL 8B (Thinking) | 25 |
| 13 | InternVL3-8B | 23.5 |
| 14 | Qwen 3 VL 8B Instruct | 22.5 |
| 15 | InternVL3.5-8B | 19.5 |
Interactive version: theaggregate.ai/benchmark?slug=chronophybench-next-state-selection-6-options · How It Works · Data refreshed daily, snapshot 2026-09-29.