DiscoBench - Guided - Detection F1: leaderboard
F1 for detecting when a query needs clarification. Interactive deep search with ambiguity checkpoints, Tavily search and Gemini 3 Flash Medium user simulation. Table 2 of paper v2; Neutral and Guided prompts stay separate. Model effort settings follow the API appendix. GPT-5.4 has no Guided score. This series reports Ambiguity detection F1 (%). Source: https://arxiv.org/html/2606.27669v2.
Metric: Ambiguity detection F1 (%). Source: arxiv.org. Saturation forecast: Around February 2027. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) (High) | 75.6 | #64 (Gemini 3.1 Pro (Preview)) |
| 2 | Doubao-Seed-2-0-Pro-260215 (High) | 73.9 | |
| 3 | Kimi K2.6 (Thinking) | 71 | #113 (Kimi K2.6) |
| 4 | GLM-5.1 (Thinking) | 69.8 | #109 (GLM-5.1) |
| 5 | Claude Opus 4.7 (Max) | 68.9 | #51 (Claude Opus 4.7) |
| 6 | DeepSeek V4 Pro (Max) | 63.7 | #112 (DeepSeek V4 Pro) |
| 7 | Hy3-preview (High) | 62.1 | #166 (Hy3-preview) |
| 8 | MiMo-V2.5-Pro (Thinking) | 59.5 | #167 (MiMo-V2.5-Pro) |
| 9 | Qwen 3.6 Max (Preview) (Thinking) | 51.8 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=discobench-guided-detection-f1 · How It Works · Data refreshed daily, snapshot 2026-11-05.