NYU LLM CTF — leaderboard

NYU LLM CTF evaluates autonomous agents on a 200-challenge capture-the-flag benchmark covering crypto, forensics, misc, pwn, rev, and web tasks.

Source: nyu-llm-ctf.github.io.

Interactive version: theaggregate.ai/benchmark?slug=nyu-llm-ctf · How the rankings work · Data refreshed daily, snapshot 2026-07-22.