HELM AIR-Bench 2024 - Sexual Content: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)95.14
2Claude Haiku 4.5 (20251001)87.5
3Claude 3.5 Sonnet (20240620)82.99
4Claude 3 Sonnet (20240229)82.64
5Claude Sonnet 4 (20250514)81.94
6Claude 3 Haiku (20240307)80.56
7Llama 3 8B Instruct80.21
8Claude Opus 4 (20250514)79.17
9GPT-OSS-20B78.82
10Qwen 3 Next 80B A3B (Thinking)77.78
11Granite 3.3 8B Instruct75.69
12GPT-OSS-120B75.35
13Claude 3.7 Sonnet (20250219)75.35
14Granite 4.0 Micro73.96
15Claude Sonnet 4.571.88

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-sexual-content · How It Works · Data refreshed daily, snapshot 2026-09-19.