CoRE (Code Reasoning) - RHDA-2: leaderboard

CoRE (2026) tests code reasoning on 60 HumanEval and LiveCodeBench problems, each with several functionally equivalent implementations and probes of intermediate execution states, here with the RHDA reasoning framework (Zhao et al., 2025) with two iterations. The Reasoning Consistency Score in percent credits a problem only when every implementation is predicted correctly, scaled by the share of intermediate probes answered correctly; higher is better.

Metric: Reasoning Consistency Score (RCS, %) with the RHDA reasoning framework (Zhao et al., 2025) with two iterations: 60 HumanEval and LiveCodeBench problems with 255 expert-verified functionally equivalent implementations and intermediate-state probes; per problem the score is the strict output consistency (every implementation and test predicted correctly, 0 or 1) times the share of intermediate probes answered correctly, averaged over problems; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1O359.16#237
2GPT-558.48#178
3CoRE Claude-4.5 (checkpoint unspecified)54.45
4DeepSeek V3.248.7#419
5DeepSeek R147.16#482
6Gemini-2.5 (CoRE checkpoint unspecified)44.25
7Claude 3.7 Sonnet42.77#470
8Qwen 3 235B A22B10.66#628

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=core-code-reasoning-rhda-2 · How It Works · Data refreshed daily, snapshot 2026-11-21.