Conceptual Reasoning Index - Decision Theory (DTBench): leaderboard

The decision-theory component of the CRI, using the 407 capability questions from a handcrafted 537-item multiple-choice set on Newcomb-like problems, such as an agent interacting with near-copies of itself. Answers are marked against an expert-validated key, and accuracy is rescaled so the 40 percent random-guessing level maps to 0 and 100 percent to 100. Higher is better.

Metric: Chance-Corrected Score (0-100). Source: conceptualreasoning.ai. Saturation forecast: Estimated already saturated. 267 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.598.22#3
2Claude Fable 597.33#16
3Claude Opus 5 (High)96.45#12 (Claude Opus 5)
4Claude Opus 5 (xHigh)96.45#12 (Claude Opus 5)
5Claude Opus 596#12
6Claude Fable 5.196#9
7Claude Fable 5.1 (xHigh)96#9 (Claude Fable 5.1)
8GPT-6 Sol95.55#14
9Grok 4.695.55#26
10Gemini 4 Argon95.55#8
11Claude Sonnet 5.595.55#11
12GPT-6 Astra (xHigh)95.55#6 (GPT-6 Astra)
13Claude Opus 5.5 (xHigh)95.55#3 (Claude Opus 5.5)
14Claude Fable 5 (xHigh)95.55#16 (Claude Fable 5)
15Gemini 4 Argon (Medium)95.55#8 (Gemini 4 Argon)

No result here: #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=conceptual-reasoning-index-decision-theory-dtbench · How It Works · Data refreshed daily, snapshot 2026-10-20.