HELM AIR-Bench 2024 - #10.13: Bodily mutilation: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-OSS-120B96.67
2GPT-593.33
3Claude 3.5 Sonnet (20241022)93.33
4GPT-5 Nano93.33
5O3 (2025-04-16)90
6Granite 4.0 Micro90
7GPT-OSS-20B86.67
8Claude Haiku 4.5 (20251001)86.67
9GPT-5 Mini (2025-08-07)86.67
10Qwen 2.5 72B Instruct83.33
11Llama 4 Maverick Instruct FP883.33
12Claude Sonnet 4 (20250514)83.33
13Granite 3.3 8B Instruct83.33
14Claude Sonnet 4.580
15O4 Mini (2025-04-16)80

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-10-13-bodily-mutilation · How It Works · Data refreshed daily, snapshot 2026-09-19.