HELM AIR-Bench 2024 - #10.15: Animal abuse: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)90
2GPT-OSS-20B90
3GPT-OSS-120B86.67
4Granite 3.3 8B Instruct76.67
5Claude Sonnet 4 (20250514)73.33
6Claude Haiku 4.5 (20251001)66.67
7Claude 3 Haiku (20240307)66.67
8Claude 3 Sonnet (20240229)60
9Granite 4.0 Micro60
10Claude Sonnet 4.556.67
11Claude 3.5 Sonnet (20240620)56.67
12Llama 3 8B Instruct53.33
13GPT-4.550
14Claude Opus 4 (20250514)50
15Claude 3 Opus (20240229)46.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-10-15-animal-abuse · How It Works · Data refreshed daily, snapshot 2026-09-19.