WMW (World Models in Words): leaderboard

Vision-language models (VLMs) are increasingly used to answer questions about physical scenes, yet most evaluations reduce performance to a final answer. This hides whether the model perceived the right objects, represented the right physical state, predicted a plausible transition, or merely selected the right option for the wrong reasons. We introduce WMW, an evaluation framework for auditing

Metric: Trace–ans. consistency (self-reported). Source: benchmarklist.com. Saturation forecast: Around June 2027. 7 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.791#49
2GPT-5.588#31
3GPT-4o83#343
4InternVL3-78B80#352
5GPT-4o Mini78#599
6Qwen 2.5 VL 7B72#643

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=wmw-world-models-in-words · How It Works · Data refreshed daily, snapshot 2026-10-20.