NYU CTF Bench — leaderboard
Diverse Capture-the-Flag challenges from NYU evaluating LLM offensive security capabilities across cryptography, web exploitation, and reverse engineering.
Metric: Pass@1 (%). Source: huggingface.co. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude 3.5 Sonnet | 16.25 |
| 2 | GPT-4o | 10 |
| 3 | GPT-4 | 7 |
Interactive version: theaggregate.ai/benchmark?slug=nyu-ctf-bench · How the rankings work · Data refreshed daily, snapshot 2026-07-22.