CausalGame - Prompting Mode: leaderboard

The CausalGame scenarios with the model writing Python code blocks that call the game's API directly, instead of making structured tool calls in a ReAct loop. Mean survival rate over 14 scenarios and three seeds. Higher is better. Source: arxiv.org/abs/2607.04293.

Metric: Mean Survival Rate (%; 14 scenarios, 3 seeds). Source: arxiv.org. Saturation forecast: Around 2030. 30 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.768.6#53
2GLM-5.268.3#82
3Claude Opus 4.567.6#90
4Qwen 3.7 Max67.4#88
5Grok 4.1 Fast66.3#227
6Kimi K2.666.2#115
7DeepSeek V4 Pro65.2#113
8GLM-5.165.2#111
9Kimi K2.564.5#154
10Claude Sonnet 4.563.7#150
11Gemini 3.5 Flash62.9#68
12Hy3-preview60.8#168
13MiMo-V2.5-Pro60.3#169
14GPT-5.560.1#34
15MiniMax-M260#329

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=causalgame-prompting-mode · How It Works · Data refreshed daily, snapshot 2026-11-07.