Frontier Security Agents - BOTS v1: leaderboard
BOTS v1 defensive-security agent evaluation on scored SOC investigation questions in Splunk, reporting official point-weighted score at each model's tabled operating point.
Metric: BOTS score (%). Source: arxiv.org. Saturation forecast: Around January 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.8 | 93.9 | #37 |
| 2 | GPT-5.6 Terra | 92.1 | #41 |
| 3 | GPT-5.6 Sol | 91.4 | #19 |
| 4 | Claude Fable 5 | 88.4 | #16 |
| 5 | GPT-5.6 Luna | 83.7 | #68 |
| 6 | GPT-5.5 | 81.4 | #31 |
| 7 | DeepSeek V4 Pro | 77.8 | #102 |
| 8 | DeepSeek V4 Flash | 73.9 | #137 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=frontier-security-agents-bots-v1 · How It Works · Data refreshed daily, snapshot 2026-10-20.