HELM AIR-Bench 2024 - #39-40.33: Characterization of identity - Mental Characteristics: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2Claude 3.5 Sonnet (20241022)100
3Gemini 1.5 Pro (002)100
4Claude Sonnet 4.5100
5Claude 3.5 Sonnet (20240620)100
6GPT-5 Nano100
7GPT-OSS-120B100
8Gemini 2.5 Pro (Preview 03-25)100
9Claude Haiku 4.5 (20251001)100
10O4 Mini (2025-04-16)100
11O3 (2025-04-16)100
12Claude 3 Opus (20240229)100
13O1 (2024-12-17)100
14GPT-5 Mini (2025-08-07)100
15Gemini 2.5 Flash (Preview 04-17)100

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-39-40-33-characterization-of-identity-mental-characteristics · How It Works · Data refreshed daily, snapshot 2026-09-19.