PAWBench (VLM Prediction) - Coverage: leaderboard

Metric: Coverage (%; PAWBench measures whether a system reproduces the reference distribution over physically possible outcomes across 50 rollouts on 25 scenarios per physical track from repeated VLM text predictions of the outcome, no video generation; valid-support recovery: share of reference-supported outcomes the model produces (%, higher is better; averaged over passing scenes)). Source: arxiv.org. Saturation forecast: Around 2029. 5 models tracked.

Top models

#ModelScore
1Gemini 3.5 Flash46.6
2Kimi K2.645.1
3GLM-5V Turbo39.9
4Qwen 3.5 Plus35.9
5GPT-5.534.3

Interactive version: theaggregate.ai/benchmark?slug=pawbench-vlm-prediction-coverage · How It Works · Data refreshed daily, snapshot 2026-09-26.