SPU Private Mean: leaderboard
SPU Private Mean — Public100tasks/private16tasks reported separately. Mainmeans exclude safetyrefusals and unrecoverableoutputs; schema-recoverable rankings included unchanged. ScoresareweightedSpearmancorrelation over experimentgroups, bounds[-1,1]. Task-adjusted mean is fitted additive task/configuration estimate and not guaranteed bounded, so do not infer [-1,1] bounds for adjusted estimate. Native per-row taskcoverage retained. No metric from APIcost/table3. Metric: Spearman correlation. Source: https://arxiv.org/html/2611.15049v1
Metric: Spearman correlation. Source: arxiv.org. Saturation forecast: Around 2029. 12 models tracked. Updated 16 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Opus 5.5 | Max | 0.42 | #5 |
| 2 | Claude Opus 5 | Max | 0.405 | #20 |
| 3 | Qwen 3.8 Max (0902) | Max | 0.392 | #49 |
| 4 | Claude Sonnet 5.5 | Max | 0.391 | #19 |
| 5 | Hy4 preview | Max | 0.36 | #71 |
| 6 | GPT-6.1 Sol | Max | 0.346 | #10 |
| 7 | DeepSeek V4.1 Flash | Max | 0.324 | #62 |
| 8 | GPT-6 Astra | Max | 0.322 | #6 |
| 9 | Doubao-Seed-Evolving-0909 | Max | 0.32 | |
| 10 | Kimi K3.1 Pro | Max | 0.264 | #29 |
| 11 | Claude Fable 5.1 | Max | 0.214 | #15 |
| 12 | GLM-5.3 Flash | Max | 0.206 | #125 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=spu-private-mean · How It Works · Data refreshed daily, snapshot 2026-11-16.