LongCoT - Chemistry: leaderboard

Long-horizon chain-of-thought reasoning on the medium and hard chemistry problems of LongCoT (2026), expert-templated problems with short inputs and verifiable answers whose solutions need tens of thousands of reasoning tokens, single attempt without tools at the highest available reasoning setting. Accuracy in percent; higher is better.

Metric: Accuracy (%) on the medium and hard chemistry problems of LongCoT (main set; long-horizon chain-of-thought problems with short inputs, verifiable answers and 10K to 100K+ token reasoning), single-shot, highest available reasoning setting up to the provider output limit, no tools; higher is better. Source: arxiv.org. Saturation forecast: Around March 2028. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 Pro14#145
2GPT-5.2xHigh10.2#185
3Claude Sonnet 4.5Thinking3.3#261
4Grok 4.1 FastReasoning3#427
5Kimi K2 (Thinking)0.8
6DeepSeek V3.2Thinking0.5#419
7GLM-4.70.3#380

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=longcot-chemistry · How It Works · Data refreshed daily, snapshot 2026-11-21.