SGR-Bench: leaderboard

Recent advances in large language models and tool-using agents have expanded the range of benchmarked web tasks. Yet an important class of specialized retrieval tasks remains undercharacterized. On many specialized data-retrieval websites, answer-bearing evidence becomes accessible only after establishing the correct site-specific retrieval state through filters, views, hierarchies, or scopes. We

Metric: Item-F1 (self-reported). Source: benchmarklist.com. Saturation forecast: Around August 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.566.18#31
2GLM-5.165.64#97
3Claude Opus 4.761.38#49
4DeepSeek V4 Pro60.98#102
5Gemini 3.1 Pro (Preview)59.06#58
6Kimi K2.547.39#144
7Qwen 3.6 Plus36.88#120
8Seed 2.0 Pro29.88#118

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=sgr-bench · How It Works · Data refreshed daily, snapshot 2026-10-20.