SkillSafetyBench - Knowledge, Model and Supply Chain: leaderboard

The supply-chain risk domain of SkillSafetyBench (Jin et al., 2026): 26 cases in which compromised knowledge sources, dependencies, model artifacts, retrieval corpora or services mislead a CLI coding agent. Attack success rate in percent, judged by case-specific verifiers; each row is a CLI agent harness with a model backend; lower is better.

Metric: Attack success rate (%; 26 cases of compromised knowledge sources, model behavior, dependencies, retrieval corpora or supply-chain components; rule-based case verifiers; each row is a CLI agent harness with a model backend, one run per case). Source: arxiv.org. Saturation forecast: Not forecast. 9 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.611.5#100
2MiniMax-M2.715.4#519
3Kimi K2.519.2#252
4GPT-5.423.1#121
5Gemini 3 Flash23.1#159
6GLM-5.123.1#175
7GPT-5.526.9#48

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=skillsafetybench-knowledge-model-and-supply-chain · How It Works · Data refreshed daily, snapshot 2026-11-12.