SCAM - With Security Skill: leaderboard

The same 30 SCAM scenarios re-run with 1Password's plain-text security skill prepended to the agent's system prompt, which teaches it to verify domains, inspect content and protect credentials before acting. Read against the base SCAM board it measures how much of an agent's security gap is closed by instructions alone.

Metric: Safe Behaviour Rate (%). Source: 1password.github.io. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash99#99
2Claude Opus 4.698#63
3Claude Haiku 4.598#280
4Claude Sonnet 498#199
5GPT-5.297#110
6GPT-4.196#248
7Gemini 2.5 Flash95#245
8GPT-4.1 Mini95#355

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=scam-with-security-skill · How It Works · Data refreshed daily, snapshot 2026-10-20.