ChronoPhyBench - Next-State Selection (6 Options): leaderboard

ChronoPhyBench (2026) tests whether multimodal models predict what happens next in real physical-interaction videos rather than relying on language priors. On this board the model sees eight frames of a video with its caption and chooses the next frame from six candidates; the score is accuracy (chance 16.7 percent). Higher is better.

Metric: Accuracy (%) on ChronoPhyBench next-state frame selection with 6 candidates: given a real physical-interaction video context (8 uniformly sampled frames) and its caption, choose the frame that comes next; closed models at temperature 0.1, open models at their recommended sampling; chance 16.7; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 25 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.570.5#49
2Doubao-Seed-2.0-Pro-26021565#152
3Gemini 3 Pro (Preview)63#113
4Doubao-Seed-1-8-25122853#282
5Gemini 2.5 Pro46.63#266
6GLM-4.1V-9B (Thinking)39.5#1060 (GLM-4.1V-9B)
7Doubao-Seed-1.6-thinking-25071538.5#324
8Gemini 2.5 Flash37.85#453
9GPT-5.437.5#123
10GPT-5.334.5#197
11Qwen 3 VL 32B Instruct25.5#585
12Qwen 3 VL 8B (Thinking)25#887
13InternVL3-8B23.5#1688
14Qwen 3 VL 8B Instruct22.5#981
15InternVL3-14B18.5#1182

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=chronophybench-next-state-selection-6-options · How It Works · Data refreshed daily, snapshot 2026-11-13.