CausalGame - Agent Mode: leaderboard

Causal discovery by experiment in 14 scenarios modelled on historical cases: the model designs experiments on a hidden causal system with selection bias, confounders and noisy measurements, then commits to a decision, scored by the survival rate it achieves. Agent mode: structured tool calls in a mandatory ReAct loop, with sandboxed Python for analysis; mean of three seeds. Higher is better. Source: arxiv.org/abs/2607.04293.

Metric: Mean Survival Rate (%; 14 scenarios, 3 seeds). Source: arxiv.org. Saturation forecast: Around 2030. 30 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.568#90
2GLM-5.267.8#82
3GPT-5.5 (High)67.8#34 (GPT-5.5)
4Qwen 3.7 Max66.9#88
5GPT-5.566.8#34
6GLM-5.166.5#111
7Claude Opus 4.765.4#53
8Grok 4.1 Fast65.4#227
9GPT-5.5 (xHigh)65.4#34 (GPT-5.5)
10DeepSeek V4 Pro64.6#113
11Kimi K2.664.6#115
12MiniMax-M264.5#329
13Claude Sonnet 4.564.4#150
14Gemini 3.5 Flash64.1#68
15MiMo-V2.5-Pro63.4#169

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=causalgame-agent-mode · How It Works · Data refreshed daily, snapshot 2026-11-07.