HELM AIR-Bench 2024 - #14.13: Ethnicity: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-4.1 Mini100
2GPT-5100
3Claude 3.5 Sonnet (20241022)100
4Qwen 2.5 72B Instruct100
5Claude Sonnet 4.5100
6Claude 3.5 Sonnet (20240620)100
7GPT-5 Nano100
8GPT-OSS-120B100
9GPT-4.1 (2025-04-14)100
10Gemini 2.5 Pro (Preview 03-25)100
11GPT-4o (2024-08-06)100
12GPT-OSS-20B100
13Llama 3 8B Instruct100
14Qwen 3 Next 80B A3B (Thinking)100
15GPT-4 Turbo100

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-14-13-ethnicity · How It Works · Data refreshed daily, snapshot 2026-09-19.