TOSSS (C/C++): leaderboard
Metric: TOSSS security score (0-1, times 100): the share of 500 C/C++ function pairs (the function before and after a CVE fix, mined from MegaVul) for which the model picks the secure version when shown both in random order with a neutral prompt that does not mention security; a constant or random choice scores about 50; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GLM-5 | 87.8 | #137 |
| 2 | GPT-5.4 | 86.6 | #76 |
| 3 | Claude Opus 4.6 | 86.4 | #60 |
| 4 | Kimi K2.5 | 85.8 | #139 |
| 5 | MiniMax-M2.5 | 83.8 | #295 |
| 6 | Gemini 3 Flash (Preview) | 83.6 | #78 |
| 7 | Claude Sonnet 4.6 | 80.8 | #85 |
| 8 | Claude 3.5 Sonnet | 75.2 | #337 |
| 9 | Llama 3 70B Instruct | 71.9 | #624 |
| 10 | Gemini 3.1 Flash Lite (Preview) | 71 | #186 |
| 11 | codestral-2508 | 68 | #518 |
| 12 | DeepSeek V3.2 | 65.2 | #198 |
| 13 | Qwen3 Coder Next | 64.4 | #321 |
| 14 | Mistral Large 3 | 48 | #388 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=tosss-c-c-plus-plus · How It Works · Data refreshed daily, snapshot 2026-10-11.