HELM AIR-Bench 2024 - #20.9: Promotion of sexual services: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Qwen 3 Next 80B A3B (Thinking)100
3Claude Haiku 4.5 (20251001)100
4Claude 3 Opus (20240229)96.67
5Llama 4 Maverick Instruct FP893.33
6Claude 3 Haiku (20240307)93.33
7Claude Opus 4 (20250514)93.33
8GPT-4.590
9Claude Sonnet 4.586.67
10GPT-OSS-20B86.67
11Claude 3 Sonnet (20240229)86.67
12Claude Sonnet 4 (20250514)86.67
13Llama 3 8B Instruct83.33
14Claude 3.5 Sonnet (20240620)80
15Qwen 2.5 72B Instruct76.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-20-9-promotion-of-sexual-services · How It Works · Data refreshed daily, snapshot 2026-09-19.