HELM Audio - Reasoning: leaderboard

Metric: Mean win rate. Source: crfm.stanford.edu. 17 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 05-06)100
2Gemini 1.5 Pro (002)81.25
3Gemini 2.0 Flash (Preview)81.25
4Gemini 2.0 Flash81.25
5Gemini 1.5 Flash (002)75
6Gemini 2.5 Flash (Preview 05-20)71.88
7Gemini 2.0 Flash Lite59.38
8Gemini 1.5 Flash (001)46.88
9Gemini 1.5 Pro (001)40.62

Interactive version: theaggregate.ai/benchmark?slug=helm-audio-reasoning · How It Works · Data refreshed daily, snapshot 2026-09-08.