HELM Audio - Air Bench Chat: leaderboard

Metric: GPT-4o Judge Critique. Source: crfm.stanford.edu. 15 models tracked.

Top models

#ModelScore
1Gemini 2.0 Pro (Preview 02-05)3.25
2Gemini 2.0 Flash3.2
3Gemini 2.0 Flash (Preview)3.19
4Gemini 1.5 Pro (002)3.07
5Gemini 2.0 Flash Lite (Preview 02-05)3.07
6Gemini 1.5 Flash (002)3.04
7Gemini 1.5 Flash (001)2.77
8Gemini 1.5 Pro (001)2.67

Interactive version: theaggregate.ai/benchmark?slug=helm-audio-air-bench-chat · How It Works · Data refreshed daily, snapshot 2026-09-08.