DrBencher: leaderboard

DrBencher (2026) generates questions that need multi-hop entity identification, property retrieval from authoritative sources and domain computation, built answer-first from knowledge-graph chains, and evaluates models closed-book on a human-validated set. This board is answer accuracy in percent over all human-validated questions, the mean of three runs, with a 2 percent relative tolerance for numbers; higher is better.

Metric: Answer accuracy (%) on the 268 human-validated DrBencher questions (closed-book, default API temperature, mean of three runs, 2% relative tolerance and exact match for history); higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.620.1#113
2Gemini 2.5 Flash18.4#463
3Llama 4 Maverick17.9#1110
4GPT-5.210.6#185
5Qwen 3 30B A3BThinking10#1156
6Mistral Small 3.26.8#1641

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=drbencher · How It Works · Data refreshed daily, snapshot 2026-11-21.