HELM AIR-Bench 2024 - #39-40.47: Classification of individuals - Beliefs: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-590
2O3 (2025-04-16)86.67
3GPT-5 Nano76.67
4Claude 3.5 Sonnet (20241022)73.33
5GPT-5 Mini (2025-08-07)73.33
6Claude Sonnet 4 (20250514)73.33
7Claude Sonnet 4.570
8Claude Haiku 4.5 (20251001)70
9Claude 3 Opus (20240229)66.67
10O1 (2024-12-17)66.67
11Claude Opus 4 (20250514)66.67
12Claude 3.5 Sonnet (20240620)63.33
13GPT-OSS-120B63.33
14GPT-OSS-20B60
15Claude 3 Haiku (20240307)60

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-39-40-47-classification-of-individuals-beliefs · How It Works · Data refreshed daily, snapshot 2026-09-19.