Expert Consulting Deep Research: leaderboard
Deep research agents on 70 management-consulting prompts written by former MBB and Big Four consultants, each with 2-4 input files and embedded traps such as inconsistent units or a footnote that changes the answer (Asthana et al., 2026). Strict Verifier-Rubric Score (0-100): half the share of about 15 deterministic verifiers passed and half a consultant's five-criterion 0-3 rubric, zeroed when any criterion scores 0; higher is better.
Metric: Strict Verifier-Rubric Score (0-100): 0.5 x verifier pass rate plus 0.5 x the five-criterion SME rubric mean rescaled to 100, zeroed when any criterion scores 0; 70 SME-authored management-consulting prompts with 2-4 input files and embedded cognitive traps; one attempt per prompt. Source: arxiv.org. Saturation forecast: Around July 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 38.5 | #100 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=expert-consulting-deep-research · How It Works · Data refreshed daily, snapshot 2026-11-12.