LongCoT - Chess: leaderboard
Long-horizon chain-of-thought reasoning on the medium and hard chess problems of LongCoT (2026), expert-templated problems with short inputs and verifiable answers whose solutions need tens of thousands of reasoning tokens, single attempt without tools at the highest available reasoning setting. Accuracy in percent; higher is better.
Metric: Accuracy (%) on the medium and hard chess problems of LongCoT (main set; long-horizon chain-of-thought problems with short inputs, verifiable answers and 10K to 100K+ token reasoning), single-shot, highest available reasoning setting up to the provider output limit, no tools; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 7 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5.2 | xHigh | 7.4 | #190 |
| 2 | Gemini 3 Pro | 4.9 | #146 | |
| 3 | Claude Sonnet 4.5 | Thinking | 2.3 | #267 |
| 4 | GLM-4.7 | 1.7 | #383 | |
| 5 | Kimi K2 (Thinking) | 1.4 | ||
| 6 | DeepSeek V3.2 | Thinking | 1.4 | #425 |
| 7 | Grok 4.1 Fast | Reasoning | 0 | #431 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=longcot-chess · How It Works · Data refreshed daily, snapshot 2026-11-22.