HiL-Bench: leaderboard

Scale Human-in-Loop benchmark measuring when agents should ask for help, escalate uncertainty, or continue autonomously.

Metric: Combined Pass@3 (%). Source: labs.scale.com. Saturation forecast: Around February 2027. 28 models tracked.

Top models

#ModelScoreOverall rank
1Muse Wonder79.67#15
2GPT-6 Astra65.32#6
3GPT-6.1 Sol62.33#7
4Gemini 4 Argon62#8
5Claude Fable 5.161.5#9
6Claude Opus 5.559#3
7GLM-5.358.33#39
8Claude Opus 557#12
9Claude Fable 556.33#16
10DeepSeek V4 Flash47.81#137
11GLM-5.243.67#73
12Kimi K342.67#30
13Claude Opus 4.741.67#49
14Gemini 3.8 Flash41.47#21
15GPT-5.539.67#31

No result here: #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=hil-bench · How It Works · Data refreshed daily, snapshot 2026-10-20.