WebRetriever (Protocol III, End-to-End): leaderboard
Metric: Success rate (%; 100 end-to-end tasks that require navigating and extracting a unique factual answer from text, documents or charts; live websites from WebRetriever (800 sites across consumer, professional and enterprise domains), each task starting from a fixed entry URL with search engines blocked, Playwright-based online harness; task success judged by human annotators). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro (Harness: Computer-use) | 21 |
| 2 | Claude Sonnet 4.5 (Harness: Computer-use) | 16 |
| 3 | Browser Use + GPT-4o (2024-08-06) | 11 |
| 4 | Agent-E + GPT-4o (2024-08-06) | 9 |
| 5 | UI-TARS-1.5 | 8 |
| 6 | SeeAct + GPT-4o (2024-08-06) | 6 |
Interactive version: theaggregate.ai/benchmark?slug=webretriever-protocol-iii-end-to-end · How It Works · Data refreshed daily, snapshot 2026-09-29.