PWNBench v0.1: leaderboard

An agent penetration-tests live web applications in one fixed greybox harness and reports the vulnerabilities it finds; the score is F0.5 over those reports at an attempt budget of 3, from Novee's own runs. It scores precision-weighted findings against running apps rather than captured flags.

Metric: F0.5 of reported findings at an attempt budget of 3 (%). Source: fireworks.ai. Saturation forecast: Around April 2028. 10 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Grok 4.6xHigh63.31#45
2Claude Opus 5Max59.96#20
3Claude Opus 4.8Max55.59#58
4GPT-5.6 SolMax54.01#30
5Grok 4.5xHigh49.12#85
6GLM-5.3Low48.75#68
7Kimi K3xHigh48.19#56
8Claude Opus 4.6Max47.91#106
9GLM-5.2Non-reasoning44.26#141
10Nemotron 3 UltraMax18.76#428

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=pwnbench-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-16.