HeaRTS - Temporal Ordering: leaderboard

Metric: Mean task score (x100) over HeaRTS's temporal ordering tasks (Deduction category: ordering signals in time), each scored 0 to 1 by accuracy; the model reasons over the signal files by writing and running Python code in a CodeAct agent loop with a minimal package set; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)70#54
2GLM-5 (Thinking)68#137 (GLM-5)
3DeepSeek V3.162#260
4Gemini 2.5 Flash60#237
5Kimi K2 (Thinking)60#236 (Kimi K2)
6Grok 4.1 Fast (Reasoning)60#208 (Grok 4.1 Fast)
7GLM-4.7 (Thinking)60#185 (GLM-4.7)
8Gemini 2.5 Pro59#145
9GPT-5 Mini57#176
10GPT-4.1 Mini56#346
11Claude Haiku 4.555#271
12Qwen 3 Coder 480B A35B Instruct51#302
13Llama 4 Maverick50#451
14MiniMax-M250#307
15Nemotron Nano 12B V245#656

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=hearts-temporal-ordering · How It Works · Data refreshed daily, snapshot 2026-10-11.