HoF-Bench: leaderboard
Metric: CVEs rediscovered at pass@4 (out of 95), with the generated-context stage, on 95 public AI-discovered CVEs in eight repositories pinned at vulnerable commits, found by a minimal fixed LLM scanner scaffold with four repeated passes and multi-round triage, credited only when a detector-blinded GPT-5.6 terra judge matches code path, root cause, attack condition and impact; medium reasoning effort where supported. Source: arxiv.org. Saturation forecast: Around May 2027. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.6 Luna (Medium) | 65 |
| 2 | DeepSeek V4 Flash | 62 |
| 3 | GPT-5.4 Mini (Medium) | 58 |
| 4 | Gemini 3.5 Flash (Medium) | 56 |
| 5 | GPT-OSS-120B | 52 |
| 6 | Qwen 3.6 35B A3B | 50 |
| 7 | Gemini 2.5 Flash (Medium) | 47 |
| 8 | GPT-5.4 Nano (Medium) | 46 |
| 9 | GPT-OSS-20B | 40 |
| 10 | Mistral Small 4 | 38 |
Interactive version: theaggregate.ai/benchmark?slug=hof-bench · How It Works · Data refreshed daily, snapshot 2026-09-29.