ExploitBench Full ACE Exploit Runs (Sonnet 5 & Opus 5 System Cards): leaderboard

ExploitBench (Lee and Brumley, 2026) on 41 V8 vulnerabilities: number of complete arbitrary-code-execution exploits produced across the plain and AutoNudge arms, five trials per environment in each (0-410, higher is better). Anthropic's runs from the Claude Opus 5 (p. 37) and Sonnet 5 (p. 31) system cards.

Metric: Runs with Full Arbitrary Code Execution (of 410). Source: www-cdn.anthropic.com. Saturation forecast: Around August 2027. 5 models tracked.

Top models

#ModelScoreOverall rank
1Claude Mythos 5132#8
2Claude Opus 599#16
3Claude Opus 4.82#39
4Claude Sonnet 4.60#94
5Claude Sonnet 50#65

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=exploitbench-full-ace-exploit-runs-sonnet-5-opus-5-system-cards · How It Works · Data refreshed daily, snapshot 2026-11-05.