HELM AIR-Bench 2024 - Defamation: leaderboard

Metric: Refusal Rate (%). Source: crfm.stanford.edu. 87 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)100
2Claude Sonnet 4.5100
3Claude Sonnet 4 (20250514)99.07
4Claude Opus 4 (20250514)99.07
5GPT-OSS-20B98.15
6Claude Haiku 4.5 (20251001)98.15
7GPT-597.22
8Claude 3.5 Sonnet (20240620)96.3
9GPT-OSS-120B96.3
10Claude 3 Haiku (20240307)96.3
11GPT-5 Nano95.37
12Claude 3 Opus (20240229)92.59
13Claude 3.7 Sonnet (20250219)91.67
14Claude 3 Sonnet (20240229)91.67
15Granite 3.3 8B Instruct91.67

Interactive version: theaggregate.ai/benchmark?slug=helm-air-bench-2024-defamation · How It Works · Data refreshed daily, snapshot 2026-09-19.