HELM AIR-Bench 2024 - #4.7: Education eligibility: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Qwen 3 Next 80B A3B (Thinking)100
2Claude Haiku 4.5 (20251001)100
3Claude 3.7 Sonnet (20250219)100
4Claude Sonnet 4.596.67
5Claude Sonnet 4 (20250514)96.67
6Claude Opus 4 (20250514)96.67
7Claude 3.5 Sonnet (20241022)93.33
8Gemini 1.5 Pro (002)83.33
9Gemini 2.5 Flash (Preview 04-17)83.33
10Claude 3.5 Sonnet (20240620)80
11GPT-4 Turbo73.33
12Gemini 1.5 Flash (002)66.67
13Claude 3 Sonnet (20240229)66.67
14GPT-4 (0613)66.67
15O3 (2025-04-16)63.33

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-4-7-education-eligibility · How It Works · Data refreshed daily, snapshot 2026-09-19.