CoRE (Code Reasoning) - RHDA-2: leaderboard
CoRE (2026) tests code reasoning on 60 HumanEval and LiveCodeBench problems, each with several functionally equivalent implementations and probes of intermediate execution states, here with the RHDA reasoning framework (Zhao et al., 2025) with two iterations. The Reasoning Consistency Score in percent credits a problem only when every implementation is predicted correctly, scaled by the share of intermediate probes answered correctly; higher is better.
Metric: Reasoning Consistency Score (RCS, %) with the RHDA reasoning framework (Zhao et al., 2025) with two iterations: 60 HumanEval and LiveCodeBench problems with 255 expert-verified functionally equivalent implementations and intermediate-state probes; per problem the score is the strict output consistency (every implementation and test predicted correctly, 0 or 1) times the share of intermediate probes answered correctly, averaged over problems; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | O3 | 59.16 | #237 |
| 2 | GPT-5 | 58.48 | #178 |
| 3 | CoRE Claude-4.5 (checkpoint unspecified) | 54.45 | |
| 4 | DeepSeek V3.2 | 48.7 | #419 |
| 5 | DeepSeek R1 | 47.16 | #482 |
| 6 | Gemini-2.5 (CoRE checkpoint unspecified) | 44.25 | |
| 7 | Claude 3.7 Sonnet | 42.77 | #470 |
| 8 | Qwen 3 235B A22B | 10.66 | #628 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=core-code-reasoning-rhda-2 · How It Works · Data refreshed daily, snapshot 2026-11-21.