CausalPhys - Relation Awareness: leaderboard
CausalPhys (2026) tests vision-language models on physical reasoning questions over real-world images and videos, each paired with an expert causal graph of objects, attributes and events. This board is the share in percent of directed causal dependencies that the model rationale captures, checked by a GPT-4o judge and averaged over the four domains; higher is better.
Metric: Relation Awareness (0-1 scaled to %), the share of directed causal dependencies the rationale captures, averaged over the four domains; the model writes a rationale and an answer; a GPT-4o judge makes binary checks of the rationale against the expert-annotated causal graph (typed object, attribute and event nodes with directed dependencies); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | InternVL3-78B | 30.52 | #738 |
| 2 | Claude Sonnet 4 | 27.83 | #400 |
| 3 | GPT-4o | 27.6 | #741 |
| 4 | Mistral Small 3.2 | 26.41 | #1591 |
| 5 | GPT-4o Mini | 24.68 | #1623 |
| 6 | Gemini 2.5 Flash | 24.37 | #453 |
| 7 | Phi-4 Multimodal Instruct | 21.66 | #3882 |
| 8 | Qwen 2 VL 7B | 20.02 | #2261 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=causalphys-relation-awareness · How It Works · Data refreshed daily, snapshot 2026-11-13.