WeSCE - Worst-Case Risk Reduction: leaderboard

WeSCE (Zhang et al., 2026) measures security drift when a language model edits real-world-derived Python programs under functional-only instructions: feature addition, feature removal, bug fixing and refactoring. This board is the percentage of edited programs whose worst-case vulnerability risk, from CodeQL and Bandit static analysis and Atheris fuzzing, falls after the edit, averaged over the four edit types; higher is better.

Metric: Risk reduction rate (%; share of edited programs whose worst-case-dominant risk, LogSumExp sensitivity b = 1000, is lower after the edit; 400 executable real-world-derived Python programs edited under functional-only (weak-security) instructions, 100 each for feature addition, feature removal, bug fixing and refactoring; risk before and after the edit aggregates CodeQL and Bandit static findings and 90-second Atheris fuzzing findings, severity-weighted and size-normalized, through LogSumExp; mean of the four task rates; top-p 0.9, top-k 20). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.682.25#102
2GPT-5.480#123
3Claude Sonnet 479.25#400
4DeepSeek V4 Flash74.5#258
5Kimi K2.571.75#256
6Claude Haiku 4.566#568
7Doubao-1.5-Pro-32k64#683
8GLM-4 32B58.75#1299

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=wesce-worst-case-risk-reduction · How It Works · Data refreshed daily, snapshot 2026-11-13.