VEX-Bench - Status Accuracy: leaderboard

LLM agents deciding whether a software-supply-chain vulnerability is actually exploitable in a repository (VEX status), in Docker-backed environments under a coding-agent harness; binary accuracy, mean of three runs. Higher is better. Source: arxiv.org/abs/2609.08040.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.589.3#33
2Claude Opus 4.688.4#67
3GLM-5.184.4#109
4DeepSeek V4 Pro84#112
5GPT-5.4 Mini82.2#228
6Claude Sonnet 4.681.8#94
7Kimi K2.681.8#113
8DeepSeek V4 Flash72.9#155
9MiniMax-M2.771.1#270

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=vex-bench-status-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-05.