AthenaBench: leaderboard

Each model answers six cyber-threat-intelligence tasks: 3,000 knowledge questions, 500 ATT&CK technique extractions, 2,000 CWE root-cause mappings, 500 mitigation suggestions, 2,000 CVSS severity predictions and 100 threat-actor attributions; the score is the mean of the six task scores. It extends CTIBench with rebuilt, deduplicated data and the added mitigation task.

Metric: Combined score (%): mean of the six task scores, full benchmark. Source: raw.githubusercontent.com. Saturation forecast: Around April 2027. 8 models tracked. Updated 17 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 2.5 Flash54#467
2Llama 3.3 70B Instruct46.5#1387
3Llama 3 70B Instruct44#1689
4Llama-Primus-Merged43.7#2461
5Qwen 3 14BReasoning42.7#1264
6Qwen 3 8BThinking40.1#1868
7Llama 3.1 8B Instruct38.8#4576
8Qwen 3 4B 2507 Instruct37.5#2215

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=athenabench · How It Works · Data refreshed daily, snapshot 2026-11-17.