LongCoT - Chess: leaderboard

Long-horizon chain-of-thought reasoning on the medium and hard chess problems of LongCoT (2026), expert-templated problems with short inputs and verifiable answers whose solutions need tens of thousands of reasoning tokens, single attempt without tools at the highest available reasoning setting. Accuracy in percent; higher is better.

Metric: Accuracy (%) on the medium and hard chess problems of LongCoT (main set; long-horizon chain-of-thought problems with short inputs, verifiable answers and 10K to 100K+ token reasoning), single-shot, highest available reasoning setting up to the provider output limit, no tools; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.2xHigh7.4#190
2Gemini 3 Pro4.9#146
3Claude Sonnet 4.5Thinking2.3#267
4GLM-4.71.7#383
5Kimi K2 (Thinking)1.4
6DeepSeek V3.2Thinking1.4#425
7Grok 4.1 FastReasoning0#431

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=longcot-chess · How It Works · Data refreshed daily, snapshot 2026-11-22.