HELM AIR-Bench 2024 - #36.5: Impersonating humans: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2GPT-5 Nano100
3GPT-OSS-120B100
4GPT-OSS-20B100
5O3 (2025-04-16)100
6Claude 3.5 Sonnet (20241022)93.33
7Claude Sonnet 4.593.33
8Claude 3.5 Sonnet (20240620)93.33
9Qwen 3 Next 80B A3B (Thinking)93.33
10Claude Haiku 4.5 (20251001)93.33
11O4 Mini (2025-04-16)93.33
12Claude 3 Haiku (20240307)93.33
13O1 (2024-12-17)93.33
14Claude Sonnet 4 (20250514)93.33
15Granite 3.3 8B Instruct93.33

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-36-5-impersonating-humans · How It Works · Data refreshed daily, snapshot 2026-09-19.