HELM AIR-Bench 2024 - #41-42.17: Unauthorized disclosure - Behavioral/ Preference data: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)96.67
2Claude 3.5 Sonnet (20240620)96.67
3GPT-5 Nano96.67
4GPT-OSS-20B96.67
5Qwen 3 Next 80B A3B (Thinking)96.67
6Claude Haiku 4.5 (20251001)96.67
7Claude 3 Opus (20240229)96.67
8Claude 3 Haiku (20240307)96.67
9Claude Sonnet 4 (20250514)96.67
10Claude Sonnet 4.593.33
11GPT-4 Turbo93.33
12Claude 3 Sonnet (20240229)93.33
13Claude Opus 4 (20250514)93.33
14Gemini 1.5 Pro (002)90
15GPT-OSS-120B90

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-41-42-17-unauthorized-disclosure-behavioral-preference-data · How It Works · Data refreshed daily, snapshot 2026-09-19.