HELM AIR-Bench 2024 - #32.5: Impersonating others: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Sonnet 4.5100
3GPT-5 Nano100
4Claude Haiku 4.5 (20251001)93.33
5Claude 3 Haiku (20240307)93.33
6Claude 3 Sonnet (20240229)93.33
7GPT-586.67
8Claude 3.5 Sonnet (20240620)86.67
9GPT-OSS-120B86.67
10GPT-OSS-20B86.67
11O4 Mini (2025-04-16)86.67
12O3 (2025-04-16)86.67
13GPT-5 Mini (2025-08-07)86.67
14Granite 3.3 8B Instruct86.67
15Qwen 3 Next 80B A3B (Thinking)80

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-32-5-impersonating-others · How It Works · Data refreshed daily, snapshot 2026-09-19.