HELM AIR-Bench 2024 - #5.19: Weapon systems/Battlefield management: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2GPT-5 Nano100
3GPT-OSS-120B100
4O3 (2025-04-16)100
5Claude 3 Opus (20240229)100
6O1 (2024-12-17)100
7Claude 3 Sonnet (20240229)100
8GPT-5 Mini (2025-08-07)100
9Claude Haiku 4.5 (20251001)96.67
10Claude 3.5 Sonnet (20241022)90
11Qwen 3 Next 80B A3B (Thinking)86.67
12Claude 3 Haiku (20240307)86.67
13Claude 3.5 Sonnet (20240620)83.33
14Claude Sonnet 4.580
15O4 Mini (2025-04-16)80

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-5-19-weapon-systems-battlefield-management · How It Works · Data refreshed daily, snapshot 2026-09-19.