AgentWebBench (Embedding-Selected Tools) - Question Answering: leaderboard

AgentWebBench (2026) models the Agentic Web: a user agent serves information needs over 100 ClueWeb22-B websites by coordinating with content agents or tools that each cover one website, with every LLM in thinking mode. This board is answer accuracy in percent judged by an LLM on DeepResearchGym short-answer questions, under embedding-selected tools, websites chosen by embedding similarity and queried with a per-site retrieval tool; higher is better.

Metric: Answer accuracy (%, LLM judge) on 53 DeepResearchGym short-answer questions covered by the corpus, LLM user agent under tool-based embedding selection (websites chosen by embedding similarity, documents fetched with a per-website dense retrieval tool, no content agents), thinking mode on; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3 Flash (Preview)56.6#152
2GPT-5 Mini37.74#364
3Qwen 3 Next 80B A3B (Thinking)35.85#594
4Qwen 3 30B A3B 2507 (Thinking)22.64#764
5Qwen 3 14B20.75#1269
6DeepSeek V3.2Thinking20.75#419
7Qwen 3 4B 2507 (Thinking)13.21#1433

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=agentwebbench-embedding-selected-tools-question-answering · How It Works · Data refreshed daily, snapshot 2026-11-21.