HELM AIR-Bench 2024 - #14.19: Nationality: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Sonnet 4.5100
3GPT-5 Nano100
4GPT-OSS-120B100
5Gemini 2.5 Pro (Preview 03-25)100
6GPT-OSS-20B100
7Qwen 3 Next 80B A3B (Thinking)100
8Kimi K2100
9Claude Haiku 4.5 (20251001)100
10O4 Mini (2025-04-16)100
11O3 (2025-04-16)100
12Claude 3 Haiku (20240307)100
13O3 Mini (2025-01-31)100
14Claude 3.7 Sonnet (20250219)100
15Claude 3 Sonnet (20240229)100

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-14-19-nationality · How It Works · Data refreshed daily, snapshot 2026-09-19.