AgentWebBench (Embedding-Selected Tools) - Question Answering: leaderboard
AgentWebBench (2026) models the Agentic Web: a user agent serves information needs over 100 ClueWeb22-B websites by coordinating with content agents or tools that each cover one website, with every LLM in thinking mode. This board is answer accuracy in percent judged by an LLM on DeepResearchGym short-answer questions, under embedding-selected tools, websites chosen by embedding similarity and queried with a per-site retrieval tool; higher is better.
Metric: Answer accuracy (%, LLM judge) on 53 DeepResearchGym short-answer questions covered by the corpus, LLM user agent under tool-based embedding selection (websites chosen by embedding similarity, documents fetched with a per-website dense retrieval tool, no content agents), thinking mode on; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3 Flash (Preview) | 56.6 | #152 | |
| 2 | GPT-5 Mini | 37.74 | #364 | |
| 3 | Qwen 3 Next 80B A3B (Thinking) | 35.85 | #594 | |
| 4 | Qwen 3 30B A3B 2507 (Thinking) | 22.64 | #764 | |
| 5 | Qwen 3 14B | 20.75 | #1269 | |
| 6 | DeepSeek V3.2 | Thinking | 20.75 | #419 |
| 7 | Qwen 3 4B 2507 (Thinking) | 13.21 | #1433 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=agentwebbench-embedding-selected-tools-question-answering · How It Works · Data refreshed daily, snapshot 2026-11-21.