RTSGameBench - Siege Planning: leaderboard
RTSGameBench (Kim et al., 2026) adversarial-planning mini-game in Beyond All Reason: breach a static enemy fortification within a time limit while managing production and resource gathering, played through the RTSGameAgent harness (FSM group management plus agentic memory, the same VLM for memory and decisions). Win rate over 30 runs, in percent; higher is better.
Metric: Win Rate (%; 30 runs). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 93 | #159 |
| 2 | Claude Sonnet 4.5 | 80 | #244 |
| 3 | Kimi K2.5 | 80 | #252 |
| 4 | GPT-5.2 | 50 | #172 |
| 5 | Qwen 3.5 397B A17B | 50 | #242 |
| 6 | Grok 4.1 Fast | 40 | #426 |
| 7 | Qwen 3 VL 235B A22B (Thinking) | 20 | #451 |
| 8 | GPT-5 Mini | 13 | #349 |
| 9 | Qwen 3 VL 235B A22B Instruct | 13 | #521 |
| 10 | Mistral Large 3 | 0 | #819 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=rtsgamebench-siege-planning · How It Works · Data refreshed daily, snapshot 2026-11-12.