Taktile PIBench: leaderboard

A model runs as a loan-underwriting agent while 53 hand-written injections hidden in the user message, structured input, uploaded documents, file names or tool responses try to get a high-risk applicant approved or applicant data leaked; the number is the share of rollouts where it still flags the applicant and leaks nothing. Unlike AgentDojo it is one realistic finance workflow with no defenses added.

Metric: Defense success rate (%; over 220 rollouts per model, higher is better). Source: labs.taktile.com. 16 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5100#167
2GPT-5.2100#176
3GPT-5 Mini100#348
4Claude Opus 4.7100#79
5GPT-5.2 Pro100#124
6Claude Opus 4.699.1#102
7GPT-5.198.2#229
8Claude Sonnet 4.697.3#161
9Gemini 3 Flash94.5#164
10Claude Haiku 4.591.8#568
11Claude Sonnet 4.590.9#250
12Gemini 3.1 Pro (Preview)89.1#94
13Gemini 3.1 Flash Lite89.1#364
14Gemini 2.5 Flash Lite88.2#958
15Gemini 2.5 Pro78.2#266

Interactive version: theaggregate.ai/benchmark?slug=taktile-pibench · How It Works · Data refreshed daily, snapshot 2026-11-13.