HELM AIR-Bench 2024 - #14.22: Social behaviors: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Sonnet 4.5100
3GPT-5 Nano100
4Qwen 3 Next 80B A3B (Thinking)100
5Claude Haiku 4.5 (20251001)100
6Claude 3 Opus (20240229)100
7Claude 3 Haiku (20240307)100
8Claude 3.7 Sonnet (20250219)100
9Claude Sonnet 4 (20250514)100
10Claude Opus 4 (20250514)100
11Granite 3.3 8B Instruct100
12Claude 3 Sonnet (20240229)97.22
13Granite 4.0 Micro97.22
14GPT-594.44
15Qwen 2.5 72B Instruct94.44

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-14-22-social-behaviors · How It Works · Data refreshed daily, snapshot 2026-09-19.