PASB - Context Ignoring Attack: leaderboard
Metric: Attack success rate (%) of the context ignoring attack (the injection tells the agent to ignore prior context): share of trials in which the agent calls the attacker's target skill (PASB indirect prompt injection on the deployed OpenClaw personal agent: for each of 131 risky skills from the OpenClaw skill registry a fixed benign query is answered, the step-1 tool observation carries the injected instruction, and the attack succeeds when the agent calls the targeted skill in step 2 (a sandboxed, auditable testbed); no defense; mean over repeated trials); lower is better. Source: arxiv.org. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 7B Instruct | 44.5 | #846 |
| 2 | GPT-4o Mini | 53.2 | #588 |
| 3 | Llama 3.1 70B Instruct | 58.4 | #548 |
Interactive version: theaggregate.ai/benchmark?slug=pasb-context-ignoring-attack · How It Works · Data refreshed daily, snapshot 2026-10-11.