AgentHijack - Verification: leaderboard
OSWorld Ubuntu tasks in AgentHijack (Sun et al., 2026) interrupted by a demand for login verification. Percent of tasks completed, judged by OSWorld's execution-based checkers; higher is better.
Metric: Task Success Rate (%; login verification demanded). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | UI-TARS-1.5-7B | 10.48 | |
| 2 | UI-TARS-72B-DPO | 9.42 | |
| 3 | UI-TARS-7B-DPO | 8.31 |
Interactive version: theaggregate.ai/benchmark?slug=agenthijack-verification · How It Works · Data refreshed daily, snapshot 2026-11-12.