Expert Consulting Deep Research - SME Rubric: leaderboard
Deep research agents on 70 management-consulting prompts written by former MBB and Big Four consultants, each with 2-4 input files and embedded traps such as inconsistent units or a footnote that changes the answer (Asthana et al., 2026). Mean of a consultant's 0-3 grades for data integrity, analytical rigor, relevance and focus, execution precision and format, each checked by a second reviewer; higher is better.
Metric: Mean SME rubric score (0-3; data integrity, analytical rigor, relevance and focus, execution precision, format and deliverability, each graded 0-3 by a consultant and averaged; 70 SME-authored management-consulting prompts with 2-4 input files and embedded cognitive traps; one attempt per prompt). Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 1.55 | #100 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=expert-consulting-deep-research-sme-rubric · How It Works · Data refreshed daily, snapshot 2026-11-12.