Metacognitive Probe: leaderboard

The Metacognitive Probe is an exploratory five-task, 15-slot diagnostic that decomposes an LLM's confidence behaviour into five behaviourally-distinct dimensions: confidence calibration (T1-CC), epistemic vigilance (T2-EV), knowledge boundary (T3-KB), calibration range (T4-CR), and reasoning-chain validation (T5-RCV). It is evaluated on N=8 frontier models and N=69 humans. The instrument is motiva

Metric: Mean(T1,T2,T4,T5) (self-reported). Source: benchmarklist.com. Saturation forecast: Around June 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.682#90
2Claude Opus 4.680.75#63
3GLM-574.25#141
4Gemini 2.5 Pro74#152
5Gemma 3 27B70.5#607
6Gemini 2.5 Flash70.25#245
7DeepSeek R163.75#251

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=metacognitive-probe · How It Works · Data refreshed daily, snapshot 2026-10-20.