DiscoBench - Neutral - Detection F1: leaderboard
F1 for detecting when a query needs clarification. Interactive deep search with ambiguity checkpoints, Tavily search and Gemini 3 Flash Medium user simulation. Table 2 of paper v2; Neutral and Guided prompts stay separate. Model effort settings follow the API appendix. GPT-5.4 has no Guided score. This series reports Ambiguity detection F1 (%). Source: https://arxiv.org/html/2606.27669v2.
Metric: Ambiguity detection F1 (%). Source: arxiv.org. Saturation forecast: Around November 2027. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) (High) | 64.5 | #64 (Gemini 3.1 Pro (Preview)) |
| 2 | Doubao-Seed-2-0-Pro-260215 (High) | 61.9 | |
| 3 | Claude Opus 4.7 (Max) | 48.9 | #51 (Claude Opus 4.7) |
| 4 | DeepSeek V4 Pro (Max) | 48.6 | #112 (DeepSeek V4 Pro) |
| 5 | MiMo-V2.5-Pro (Thinking) | 47.2 | #167 (MiMo-V2.5-Pro) |
| 6 | GPT-5.4 (2026-03-05) (xHigh) | 45.1 | #63 (GPT-5.4 (2026-03-05)) |
| 7 | GLM-5.1 (Thinking) | 44.2 | #109 (GLM-5.1) |
| 8 | Kimi K2.6 (Thinking) | 42.4 | #113 (Kimi K2.6) |
| 9 | Hy3-preview (High) | 40 | #166 (Hy3-preview) |
| 10 | Qwen 3.6 Max (Preview) (Thinking) | 16 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=discobench-neutral-detection-f1 · How It Works · Data refreshed daily, snapshot 2026-11-05.