LongPIBench - Resume Screening: leaderboard

Part of LongPIBench (Liu et al., 2026), which measures prompt injection hidden in long documents: the model screens 100 long synthetic resumes carrying an injected authority-spoofing instruction. Attack success rate in percent, the share of candidates marked qualified as the attacker asks, with no defense; lower is better.

Metric: Attack success rate (%; share of 100 long synthetic resumes screened against a job description; success when the decision is qualified, under the authority-spoofing prompt injection embedded in the context and the default attack goal, no defense; default inference settings, up to 20,000 output tokens (32,768 for Qwen3-8B)). Source: arxiv.org. Saturation forecast: Around September 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o76#741
2Ministral-3-8B-Instruct-251296#1858
3deepseek-llm-7B-chat97#7056
4GPT-4.198#495
5Llama 3.2 3B Instruct98#7147
6Llama 3.1 8B Instruct100#4246
7Qwen 3 8B100#1830

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=longpibench-resume-screening · How It Works · Data refreshed daily, snapshot 2026-11-13.