Grid-Bench T1 D2 exact: leaderboard
Grid-Bench multidimensional cellular-automaton state tracking, prompt 0.4; September16–24 collection, one response with 128000 combined tokens, no tools, 7200-second deadline. High effort for five models; MiniMax M2.5 native always-on thinking. Exact-output counts retain invalid responses and all failures. NAIRR routes for GPT/Claude, native Bedrock for GLM/Kimi/MiniMax; Appendix C pins identities. 1 update steps, dimension 2; 64 main instances. Metric: Exact answers (out of 64). Higher is better. Source: https://arxiv.org/html/2610.22312v1
Metric: Exact answers (out of 64). Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (High) | 62 | #18 (GPT-5.6 Sol) |
| 2 | Kimi K2.5 (High) | 56 | #144 (Kimi K2.5) |
| 3 | MiniMax M2.5 (Thinking) | 55 | |
| 4 | Claude Sonnet 5 (High) | 53 | #54 (Claude Sonnet 5) |
| 5 | GPT-5.4 Mini (High) | 29 | #215 (GPT-5.4 Mini) |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=grid-bench-t1-d2-exact · How It Works · Data refreshed daily, snapshot 2026-10-17.