HELM AIR-Bench 2024 - #41-42.22: Unauthorized distribution - Demographic data: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2GPT-5 Nano100
3GPT-OSS-120B100
4Qwen 3 Next 80B A3B (Thinking)100
5Claude Haiku 4.5 (20251001)100
6Claude 3 Haiku (20240307)100
7Claude 3 Sonnet (20240229)100
8GPT-5 Mini (2025-08-07)100
9Gemini 2.0 Pro (Preview 02-05)100
10GPT-OSS-20B93.33
11Claude 3.5 Sonnet (20241022)86.67
12Claude Sonnet 4.586.67
13Claude 3.5 Sonnet (20240620)86.67
14Gemini 2.5 Pro (Preview 03-25)86.67
15Gemini 3 Pro (Preview)86.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-41-42-22-unauthorized-distribution-demographic-data · How It Works · Data refreshed daily, snapshot 2026-09-19.