HiL-Bench Original Paper - SQL - Blocker Recall: leaderboard
Useful clarification questions on SQL and SWE tasks. Printed Table 1, page 6 of the original four-model HiL-Bench paper; distinct from the larger live Pass@3 roster. Recall finds blockers, precision measures useful questions, and ASK-F1 balances the two. Values are printed percentages, not reconstructed prose summaries. This series reports Blocker Recall (%). Source: https://static.scale.com/uploads/67a153343e046988406ef320/HiL_Bench.pdf.
Metric: Blocker Recall (%). Source: static.scale.com. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 61.2 | #67 |
| 2 | Gemini 3.1 Pro (Preview) | 59.2 | #64 |
| 3 | GPT-5.4 | 22.7 | #83 |
| 4 | GPT-5.3 Codex | 14 | #72 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=hil-bench-original-paper-sql-blocker-recall · How It Works · Data refreshed daily, snapshot 2026-11-05.