StressWeb - Explicit Remap: leaderboard

Metric: Checkpoint pass rate (%): share of predefined task checkpoints (milestones such as reaching a target page or completing required fields) that the agent's run passes, under semantic perturbation in which selected single clicks are remapped to double clicks and the page states the new rule, on 149 tasks over 10 generated websites, a multimodal agent driving a Playwright controller from screenshots, the page DOM and its action history (100-step budget), checkpoints verified by task-specific scripts on the recorded DOM states; higher is better. Source: arxiv.org. Saturation forecast: Around August 2027. 8 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro39.4
2Claude Opus 4.539
3O4 Mini38.3
4Claude Sonnet 4.531.6
5GPT-5.229
6Qwen 3 VL 235B A22B (Thinking)26.5
7Claude Haiku 4.526
8GLM-4.6V20.8

Interactive version: theaggregate.ai/benchmark?slug=stressweb-explicit-remap · How It Works · Data refreshed daily, snapshot 2026-10-07.