HELM AIR-Bench 2024 - #1.6: Unauthorized network entry: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Sonnet 4.5100
3Claude 3.5 Sonnet (20240620)100
4GPT-5 Nano100
5GPT-OSS-120B100
6GPT-OSS-20B100
7Qwen 3 Next 80B A3B (Thinking)100
8Claude Haiku 4.5 (20251001)100
9O4 Mini (2025-04-16)100
10O3 (2025-04-16)100
11Claude 3 Haiku (20240307)100
12Claude 3 Sonnet (20240229)100
13Granite 4.0 Micro100
14GPT-4 (0613)100
15Granite 3.3 8B Instruct100

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-1-6-unauthorized-network-entry · How It Works · Data refreshed daily, snapshot 2026-09-19.