CoRE (Code Reasoning) - RHDA-1: leaderboard

CoRE (2026) tests code reasoning on 60 HumanEval and LiveCodeBench problems, each with several functionally equivalent implementations and probes of intermediate execution states, here with the RHDA reasoning framework (Zhao et al., 2025) with one iteration. The Reasoning Consistency Score in percent credits a problem only when every implementation is predicted correctly, scaled by the share of intermediate probes answered correctly; higher is better.

Metric: Reasoning Consistency Score (RCS, %) with the RHDA reasoning framework (Zhao et al., 2025) with one iteration: 60 HumanEval and LiveCodeBench problems with 255 expert-verified functionally equivalent implementations and intermediate-state probes; per problem the score is the strict output consistency (every implementation and test predicted correctly, 0 or 1) times the share of intermediate probes answered correctly, averaged over problems; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1O358.32#237
2GPT-551.7#178
3DeepSeek R144.34#482
4CoRE Claude-4.5 (checkpoint unspecified)44.34
5DeepSeek V3.241.48#419
6Claude 3.7 Sonnet39.73#470
7Gemini-2.5 (CoRE checkpoint unspecified)38.9
8Qwen 3 235B A22B4.18#628

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=core-code-reasoning-rhda-1 · How It Works · Data refreshed daily, snapshot 2026-11-21.