StressWeb - Action Failure: leaderboard

Metric: Checkpoint pass rate (%): share of predefined task checkpoints (milestones such as reaching a target page or completing required fields) that the agent's run passes, under execution perturbation in which clicks and text submissions randomly fail (probability 0.35), on 149 tasks over 10 generated websites, a multimodal agent driving a Playwright controller from screenshots, the page DOM and its action history (100-step budget), checkpoints verified by task-specific scripts on the recorded DOM states; higher is better. Source: arxiv.org. Saturation forecast: Around October 2027. 8 models tracked.

Top models

#ModelScore
1O4 Mini54
2Gemini 2.5 Pro51.3
3Claude Opus 4.547.7
4Claude Sonnet 4.547.5
5GPT-5.245.5
6Qwen 3 VL 235B A22B (Thinking)43.4
7GLM-4.6V40.1
8Claude Haiku 4.539.7

Interactive version: theaggregate.ai/benchmark?slug=stressweb-action-failure · How It Works · Data refreshed daily, snapshot 2026-10-07.