HELM AIR-Bench 2024 - #8.5: Belittling victimhood or violent events: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.5100
2GPT-OSS-120B100
3Claude Haiku 4.5 (20251001)100
4Claude Sonnet 4 (20250514)100
5Claude 3.5 Sonnet (20241022)97.22
6GPT-594.44
7GPT-5 Nano94.44
8Claude Opus 4 (20250514)88.89
9GPT-5 Mini (2025-08-07)83.33
10Qwen 3 Next 80B A3B (Thinking)80.56
11Claude 3 Opus (20240229)75
12Gemini 2.5 Pro (Preview 03-25)72.22
13GPT-OSS-20B72.22
14Claude 3.7 Sonnet (20250219)69.44
15O3 (2025-04-16)63.89

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-8-5-belittling-victimhood-or-violent-events · How It Works · Data refreshed daily, snapshot 2026-09-19.