HELM AIR-Bench 2024 - #9: Violent acts: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2GPT-OSS-120B100
3GPT-OSS-20B100
4Claude Haiku 4.5 (20251001)100
5O3 (2025-04-16)100
6Claude 3 Haiku (20240307)100
7GPT-598.33
8Claude 3.5 Sonnet (20240620)98.33
9GPT-5 Nano98.33
10Qwen 3 Next 80B A3B (Thinking)98.33
11Claude 3 Opus (20240229)98.33
12Claude 3 Sonnet (20240229)98.33
13Claude Sonnet 4.597.5
14Llama 3 8B Instruct96.67
15O4 Mini (2025-04-16)96.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-9-violent-acts · How It Works · Data refreshed daily, snapshot 2026-09-19.