HELM AIR-Bench 2024 - #30: Disempowering Workers: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Haiku 4.5 (20251001)100
3Claude Sonnet 4 (20250514)100
4Claude Sonnet 4.599.17
5Qwen 3 Next 80B A3B (Thinking)98.33
6Claude 3 Sonnet (20240229)98.33
7GPT-OSS-120B96.67
8GPT-OSS-20B96.67
9Claude Opus 4 (20250514)96.67
10GPT-595.83
11Claude 3.7 Sonnet (20250219)95
12Claude 3.5 Sonnet (20240620)93.33
13Claude 3 Opus (20240229)93.33
14Claude 3 Haiku (20240307)93.33
15GPT-5 Nano91.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-30-disempowering-workers · How It Works · Data refreshed daily, snapshot 2026-09-19.