WeightBench - TR-05 Systems: Hardware-Aware Optimization (8): leaderboard

Default difficulty, seed0. Claude2samples/task; DeepSeek/GPT1sample/task. Quarantined/invalid submissions score0 (unreviewed lower bounds). Task scores average across runs then tasks; macro averages5tracks. GPT excludes4 loop Fix tasks; use common38task macro, never pool GPT9taskFix with13taskFix. Metric: Native S_WB (0–1). Source: https://arxiv.org/html/2611.18553v1

Metric: Native S_WB (0–1). Source: arxiv.org. Saturation forecast: Around 2036. 5 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1DeepSeek V4 Flash0.238#265
2Claude Sonnet 5.50.225#21
3GPT-6.1 Sol0.22#12
4Claude Opus 5.50.207#7
5Claude Haiku 5.50.177#76

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=weightbench-tr-05-systems-hardware-aware-optimization-8 · How It Works · Data refreshed daily, snapshot 2026-11-17.