PASB - Short-Term Memory Modification: leaderboard
Metric: Write success rate (%): share of the 40 cases in which the attacker changes the specified short-term memory marker to its target, checked in the OpenClaw file system (PASB direct prompt injection against the deployed OpenClaw personal agent's memory, 40 cases per task in a sandboxed testbed with canary markers; no defense; mean over repeated trials); lower is better. Source: arxiv.org. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 7B Instruct | 46.1 | #846 |
| 2 | GPT-4o Mini | 52.4 | #588 |
| 3 | Llama 3.1 70B Instruct | 57.3 | #548 |
Interactive version: theaggregate.ai/benchmark?slug=pasb-short-term-memory-modification · How It Works · Data refreshed daily, snapshot 2026-10-11.