AgentHijack - Pop-ups: leaderboard
OSWorld Ubuntu tasks in AgentHijack (Sun et al., 2026) with a 960x540 pop-up window on the desktop, by default a prompt to install a new extension before continuing. Percent of tasks completed, judged by OSWorld's execution-based checkers; higher is better.
Metric: Task Success Rate (%; pop-up window corruption). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | UI-TARS-72B-DPO | 15.51 | |
| 2 | UI-TARS-7B-DPO | 13.09 | |
| 3 | UI-TARS-1.5-7B | 10.28 |
Interactive version: theaggregate.ai/benchmark?slug=agenthijack-pop-ups · How It Works · Data refreshed daily, snapshot 2026-11-12.