BinaryAudit: leaderboard

BinaryAudit (Quesma) — auditing compiled binaries for vulnerabilities and behavior without source access; average success rate across audit tasks.

Metric: Avg Success Rate (%). Source: quesma.com. Saturation forecast: Not forecast. 26 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.3 Codex94.12#69
2GPT-5.2 Codex (xHigh)90.67#95 (GPT-5.2 Codex)
3GPT-588.89#98
4GPT-5.2 Codex (High)88.41#95 (GPT-5.2 Codex)
5Grok 4.1 Fast86.11#217
6Gemini 3.1 Pro (Preview)84.62#58
7GPT-5.484.44#79
8DeepSeek V3.283.33#205
9GPT-5.3 Codex (High)82.46#69 (GPT-5.3 Codex)
10Claude Opus 4.682.05#63
11GPT-5.4 (High)81.67#79 (GPT-5.4)
12GPT-5.3 Codex (xHigh)79.49#69 (GPT-5.3 Codex)
13Claude Sonnet 4.579.37#142
14Claude Opus 4.576#83
15Kimi K2.575.93#144

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=binaryaudit · How It Works · Data refreshed daily, snapshot 2026-10-20.