LivePI - Email: leaderboard

Email surface of LivePI (Zhao, Bhaskar and Dobriban, University of Pennsylvania, 2026): 50 injected Gmail messages (ten injection techniques by five malicious goals) that a live OpenClaw agent reads while handling a benign inbox request. Attack success rate in percent (the injection changed the trajectory and the malicious goal was achieved); lower is better.

Metric: Attack success rate (%; 50 injected Gmail messages, ten techniques by five goals). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.62#100
2Kimi K2.56#252
3GLM-56#256
4Gemini 3.1 Pro (Preview)12#91
5GPT-5.3 Codex20#114

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=livepi-email · How It Works · Data refreshed daily, snapshot 2026-11-12.