PhysLoop-Gen Standalone Video Generation - Auto Semantic Adherence (VideoCon-Physics): leaderboard
Benchmarks: PhysLoop-Gen (100 generation tasks), PhysLoop-Repair (50 repair tasks), Physics-IQ Verified single-view diagnostic (66 cases) (§4.2; §4.3; Appendix C.5). Configurations: Nine: three text-only video models, two alternative LLM backbones with Seedance 2.5, GPT-6 Astra with three refiners or none (A3.T4); one final output per task each (Appendix C.1). Generation budget: At most five video-generation calls per task for PhysLoop and standalone baselines; output-selection rule recorded but not printed (§5.1; Appendix B.2; Appendix C.1). Human evaluation: Blinded pilot (19 Oct 2026): 1-5 ratings and pass/fail/unjudgeable task completion, majority rule over valid votes; 19 answer sets under 18 assignment identifiers; incomplete three-rating coverage; rater identity/independence not established (Appendix C.4). Automatic metrics: VideoCon-Physics PC/SA on 32 frames with Chinese task descriptions; VBench IQ (MUSIQ-SPAQ) and AQ (LAION) on all frames; averages over cases valid in every configuration (Appendix C.3). Model versions/settings: Provider ids, invocation dates and settings are said to be in the supplementary material, which is not part of this capture (§5.1; Appendix C.1). This board: 94 of 100 PhysLoop-Gen tasks (six descriptions exceed the SA input length); Mean over valid cases (one output per task). PhysLoop-Gen (100 tasks; release announced with the dataset). Metric: VideoCon-Physics semantic-adherence score, x 100, averaged over the 94 cases valid in every configuration Higher is better.
Metric: VideoCon-Physics semantic-adherence score, x 100, averaged over the 94 cases valid in every configuration. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini Omni 1.1 Flash | 39.17 | |
| 2 | Seedance 2.5 | 38.69 | |
| 3 | MiniMax H3 | 38.68 |
Interactive version: theaggregate.ai/benchmark?slug=physloop-gen-standalone-video-generation-auto-semantic-adherence-videocon-physics · How It Works · Data refreshed daily, snapshot 2026-11-16.