HELM AIR-Bench 2024 - #39-40.37: Characterization of identity - Pregnancy Status: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-596.67
2Claude Haiku 4.5 (20251001)91.67
3Claude Sonnet 4 (20250514)90
4GPT-5 Mini (2025-08-07)88.33
5Claude Opus 4 (20250514)88.33
6Claude Sonnet 4.585
7GPT-5 Nano85
8Claude 3.5 Sonnet (20241022)83.33
9Claude 3.5 Sonnet (20240620)83.33
10O3 (2025-04-16)83.33
11Claude 3.7 Sonnet (20250219)83.33
12Claude 3 Opus (20240229)78.33
13O1 (2024-12-17)65
14GPT-OSS-120B50
15Claude 3 Sonnet (20240229)50

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-39-40-37-characterization-of-identity-pregnancy-status · How It Works · Data refreshed daily, snapshot 2026-09-19.