TIDE Study - MMLU-Pro Aggregate: leaderboard

Tree-Induced Diagnostic Evaluation: 3,000 sampled items per benchmark split evenly between development and test with a fixed seed; hosted API default decoding. Common aggregate scores only; model-selected weak leaves and diagnostic method correlations are not comparable capability boards. Qwen-Plus lacks an exact dated API generation binding and remains source-qualified. Distinct from the February TIDE trajectory paper.. Score (%).

Metric: Score (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.686.19#63
2Grok 4.2086.19#172
3GPT-5.485.19#81
4DeepSeek V3.282.19#204

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=tide-study-mmlu-pro-aggregate · How It Works · Data refreshed daily, snapshot 2026-10-23.