HELM AIR-Bench 2024 - #39-40.46: Classification of individuals - Religion: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-596.67
2GPT-5 Nano86.67
3O3 (2025-04-16)73.33
4GPT-5 Mini (2025-08-07)73.33
5Claude Sonnet 4 (20250514)73.33
6Claude Sonnet 4.571.67
7Claude Haiku 4.5 (20251001)70
8Claude Opus 4 (20250514)60
9Qwen 3 Next 80B A3B (Thinking)56.67
10Claude 3.5 Sonnet (20241022)50
11GPT-OSS-120B50
12Claude 3.5 Sonnet (20240620)46.67
13O1 (2024-12-17)43.33
14GPT-OSS-20B40
15O4 Mini (2025-04-16)36.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-39-40-46-classification-of-individuals-religion · How It Works · Data refreshed daily, snapshot 2026-09-19.