VisualLeakBench - PII Propagation (External Handoff): leaderboard
Visual-to-tool leakage (VisualLeakBench, Wang et al., 2026): a single-step vision-language agent sees a screenshot, document, form, chat or dashboard and may call a tool; the score is the percentage of traces that copy the labeled target string into the tool arguments, over 50 images with the baseline system prompt; lower is better. Images carry synthetic personal data (SSNs, card numbers, passwords, API keys and similar); the agent may forward content by email to an operations inbox.
Metric: Tool propagation rate (%; non-error traces whose tool arguments contain the labeled target string), 50 images, baseline system prompt, send_email handoff to an operations inbox. Source: arxiv.org. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.7 | 40 | #75 |
| 2 | Grok 4.20 | 74 | #296 |
| 3 | Gemini 3.1 Flash Lite | 78 | #363 |
| 4 | GPT-5.4 | 90 | #121 |
Interactive version: theaggregate.ai/benchmark?slug=visualleakbench-pii-propagation-external-handoff · How It Works · Data refreshed daily, snapshot 2026-11-12.