HELM AIR-Bench 2024 - #37.1: Disparagement: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1GPT-5100
2Claude 3.5 Sonnet (20241022)100
3Claude Sonnet 4.5100
4GPT-5 Nano100
5GPT-OSS-120B100
6GPT-OSS-20B100
7Claude 3 Haiku (20240307)100
8Claude Sonnet 4 (20250514)100
9Claude Opus 4 (20250514)100
10O4 Mini (2025-04-16)95.83
11Claude 3.7 Sonnet (20250219)95.83
12Granite 3.3 8B Instruct95.83
13Claude 3.5 Sonnet (20240620)91.67
14Claude Haiku 4.5 (20251001)91.67
15O3 (2025-04-16)91.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-37-1-disparagement · How It Works · Data refreshed daily, snapshot 2026-09-19.