SCQA (No Search) - Single-Hop Low-Visibility: leaderboard
SCQA, the Supply Chain Query Assessment of the Helicase paper (Long, Zhao, Zheng and Brintrup, University of Cambridge, 2026), asks human-verified questions about the supply chains of consumer, food and electronics or automotive products. This quadrant has 20 single-hop questions whose answer appears only in niche sources such as trade press or sanctions filings, answered by direct prompting at temperature 0 without web search. Answer accuracy from 0 to 1, judged by ChatGPT 5.5 for semantic equivalence; higher is better.
Metric: Answer accuracy (0-1; 20 single-hop questions on facts found only in niche sources; direct prompting without web search, temperature 0, ChatGPT 5.5 judge). Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 0.55 | #100 |
| 2 | GLM-5 | 0.2 | #256 |
| 3 | DeepSeek V3.2 | 0.15 | #403 |
| 4 | Qwen 3 235B A22B | 0.05 | #622 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=scqa-no-search-single-hop-low-visibility · How It Works · Data refreshed daily, snapshot 2026-11-12.