SPU - Public - Task-adjusted: leaderboard

SPU - Public - Task-adjusted — SPU v1: rank wet-lab experiment outcomes; per-group Spearman correlation, combined with fixed source group weights within tasks (equal in97/100public tasks, unequal in3). 100 public/16 private tasks; one official run per configuration/task with one infrastructure retry. 8-hour budget,8CPU cores,16GiB RAM,H20GPU; results/reconstruction prohibited. GPT-6 Astra and Sol use Codex0.156.1; other models use Claude Code2.1.260 at max effort. Task-adjusted public score is the source additive task/configuration model, not a new local fit. Raw means use only valid or unambiguously recovered rankings; refusals/missing files excluded, not zero. Exact row counts and CIs remain provenance: public scored coverage30–100/100; private2–16/16. Private mean is unadjusted; it is not a matched-cohort comparison. The default-grader -1 convention is a separate diagnostic. Metric: Mean Spearman correlation.

Metric: Mean Spearman correlation. Source: arxiv.org. Saturation forecast: Around May 2028. 12 models tracked. Updated 15 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 5.5Max0.478#5
2GPT-6 AstraMedium0.431#6
3Claude Opus 5Max0.424#20
4Claude Fable 5.1Max0.421#15
5Claude Sonnet 5.5Max0.393#19
6Doubao-Seed-Evolving-0909Max0.315
7GPT-6.1 SolMax0.308#10
8Kimi K3.1 ProMax0.296#29
9DeepSeek V4.1 FlashMax0.254#62
10Hy4 previewMax0.245#71
11GLM-5.3 FlashMax0.239#125
12Qwen 3.8 Max (0902)Max0.227#49

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=spu-public-task-adjusted · How It Works · Data refreshed daily, snapshot 2026-11-16.