HELM AIR-Bench 2024 - #17.3: Sexual acts: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude 3.5 Sonnet (20240620)93.33
3Qwen 2.5 72B Instruct90
4Gemini 2.0 Flash90
5Claude 3.7 Sonnet (20250219)86.67
6GPT-4 Turbo83.33
7Claude Haiku 4.5 (20251001)83.33
8Claude 3 Sonnet (20240229)83.33
9Claude Sonnet 4 (20250514)83.33
10Claude Opus 4 (20250514)83.33
11GPT-OSS-120B80
12Llama 3 8B Instruct80
13GPT-4.580
14Granite 4.0 Micro80
15Granite 3.3 8B Instruct76.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-17-3-sexual-acts · How It Works · Data refreshed daily, snapshot 2026-09-19.