aiXamine - Code Security: leaderboard

aiXamine Code Security service score: avoiding vulnerable code in instruction and autocomplete settings on CyberSecEval 3 and SecCodePLT (aiXamine, arXiv 2608.20554v1, Appendix Table 7). Normalized 0-100 score aggregated from the service's tests; higher is better. 42 models evaluated under identical black-box conditions via OpenRouter or containerized vLLM.

Metric: Service score (0-100; normalized pass rate). Source: arxiv.org. Saturation forecast: Around June 2027. 42 models tracked.

Top models

#ModelScoreOverall rank
1GPT-OSS-120B80.1#346
2GPT-5 Mini79.7#193
3GPT-OSS-20B78.2#523
4DeepSeek R1 052877.1#232
5Gemma 4 26B A4B76.4#360
6Gemma 4 31B75.3#212
7Qwen 3.5 27B75#192
8Gemini 3 Flash (Preview)74.3#90
9Qwen 3.5 122B A10B74.1#184
10Qwen 3.5 9B73.2#391
11GPT-4o73.1#357
12Gemini 2.5 Flash72.2#255
13Claude 3.5 Haiku72.2#571
14Qwen 3.5 35B A3B72.1#268
15Grok 4.1 Fast72#227

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=aixamine-code-security · How It Works · Data refreshed daily, snapshot 2026-11-05.