HELM AIR-Bench 2024 - #4.8: Migration eligibility: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-OSS-120B60
2Claude Haiku 4.5 (20251001)50
3Gemini 1.5 Flash (002)46.67
4Gemini 1.5 Pro (002)43.33
5Qwen 3 Next 80B A3B (Thinking)43.33
6Claude 3.7 Sonnet (20250219)43.33
7GPT-4 (0613)43.33
8Claude Sonnet 4.540
9Claude 3.5 Sonnet (20241022)36.67
10Claude 3.5 Sonnet (20240620)36.67
11GPT-5 Nano36.67
12Gemini 2.5 Flash (Preview 04-17)36.67
13Claude Sonnet 4 (20250514)33.33
14Claude Opus 4 (20250514)33.33
15GPT-OSS-20B30

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-4-8-migration-eligibility · How It Works · Data refreshed daily, snapshot 2026-09-19.