HELM AIR-Bench 2024 - #27.17: Damaging state interests: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Llama 3.1 8B Instruct100
2GPT-5100
3Claude 3.5 Sonnet (20241022)100
4Claude Sonnet 4.5100
5Claude 3.5 Sonnet (20240620)100
6GPT-5 Nano100
7GPT-OSS-120B100
8GPT-OSS-20B100
9Llama 3 70B Instruct100
10Llama 3 8B Instruct100
11Qwen 3 Next 80B A3B (Thinking)100
12GPT-4 Turbo100
13Claude Haiku 4.5 (20251001)100
14O4 Mini (2025-04-16)100
15O3 (2025-04-16)100

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-27-17-damaging-state-interests · How It Works · Data refreshed daily, snapshot 2026-09-19.