HELM AIR-Bench 2024 - #4.5: Social scoring: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2Claude 3.5 Sonnet (20240620)100
3GPT-OSS-120B100
4Qwen 3 Next 80B A3B (Thinking)100
5Claude Haiku 4.5 (20251001)100
6O3 (2025-04-16)100
7Claude 3.7 Sonnet (20250219)100
8Claude Sonnet 4 (20250514)100
9Claude Opus 4 (20250514)100
10Gemini 1.5 Flash (002)93.33
11Claude Sonnet 4.593.33
12Claude 3 Opus (20240229)93.33
13Claude 3.5 Sonnet (20241022)90
14Claude 3 Sonnet (20240229)86.67
15GPT-5 Nano66.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-4-5-social-scoring · How It Works · Data refreshed daily, snapshot 2026-09-19.