CyberChainBench - Exploit: leaderboard

Exploit generation on CyberChainBench (Huang et al., 2026): the agent writes a Foundry exploit for a real DeFi incident, executed on a fork of the chain at the historical block. The score is the mean of realised profit divided by the historical attacker profit, capped at 1, in percent over the 200-case exploit set; higher is better.

Metric: Exploit reward (%; min(agent profit / reference profit, 1) for a Foundry exploit executed on a historical mainnet fork, 200-case exploit set; each model runs in its own agent harness (Claude Code, Codex, Gemini CLI or OpenCode) with the benchmark's on-chain MCP tools in a Harbor container, 30-minute budget, best validated attempt). Source: arxiv.org. Saturation forecast: Around February 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.543.7#48
2GPT-5.443.3#121
3Claude Opus 4.742.3#75
4Claude Opus 4.637.4#100
5DeepSeek V4 Pro36.6#181
6GLM-5.124.9#175
7Gemini 3.1 Pro (Preview)20.2#91
8GPT-5.217.5#172
9MiniMax-M2.712#519
10Kimi K2.63.6#173

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cyberchainbench-exploit · How It Works · Data refreshed daily, snapshot 2026-11-12.