StressWeb - Pop-Up: leaderboard

StressWeb (2026) is a diagnostic stress test for web agents: generated websites with clean reference workflows are re-run under controlled perturbations, and deterministic scripts check task checkpoints on the recorded page states. This board is the checkpoint pass rate in percent under disruptive pop-up windows; higher is better.

Metric: Checkpoint pass rate (%): share of predefined task checkpoints (milestones such as reaching a target page or completing required fields) that the agent's run passes, under execution perturbation by disruptive pop-up windows that must be handled first, on 149 tasks over 10 generated websites, a multimodal agent driving a Playwright controller from screenshots, the page DOM and its action history (100-step budget), checkpoints verified by task-specific scripts on the recorded DOM states; higher is better. Source: arxiv.org. Saturation forecast: Around October 2027. 8 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1O4 Mini50.3#368
2Gemini 2.5 Pro49#276
3Claude Sonnet 4.545.2#261
4Claude Opus 4.542.3#160
5Qwen 3 VL 235B A22B (Thinking)40.9#459
6GPT-5.239.8#185
7Claude Haiku 4.538.5#583
8GLM-4.6V38#710

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=stressweb-pop-up · How It Works · Data refreshed daily, snapshot 2026-11-21.