MonitorBench: leaderboard

The evaluated model answers or acts on 19 tasks where a planted cue, a sandbagging or deception goal, a hidden side objective or an impossible test decides the outcome; a monitor reading only its chain of thought must tell what drove it. The score is the share of instances the monitor gets right, averaged over the tasks each model completed (14 for five models that refused the sandbagging and deception tasks, all 19 for three); unlike CoT faithfulness tests that ask whether a model mentions a hint, it scores whether an outside monitor can catch goal-driven behaviour from the reasoning.

Metric: Monitorability score, CoT-only monitor, average over tasks (%). Source: arxiv.org. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-OSS-120B91.5#700
2Qwen 3 235B A22B88.5#623
3Qwen 3 14B85.5#1233
4Claude Sonnet 4.584.4#250
5Claude Haiku 4.581.4#568
6GPT-576.7#167
7Gemini 3 Flash74.6#164
8GPT-5 Mini73.7#348

Interactive version: theaggregate.ai/benchmark?slug=monitorbench · How It Works · Data refreshed daily, snapshot 2026-11-13.