HELM VHELM - Mme - Celebrity: leaderboard

Metric: Prefix Quasi-Exact Match (%). Source: crfm.stanford.edu. 48 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 03-25)94.41
2GPT-4.1 (2025-04-14)92.06
3GPT-4o (2024-05-13)90.29
4Gemini 1.5 Pro (002)90
5Gemini 2.0 Pro (Preview 02-05)89.71
6GPT-4o (2024-08-06)88.82
7Claude 3.5 Sonnet (20241022)88.53
8Gemini 1.5 Flash (002)88.53
9Claude 3.5 Sonnet (20240620)87.94
10Gemini 2.0 Flash87.35
11Gemini 2.0 Flash Lite85.88
12Llama 4 Scout Instruct84.41
13GPT-4o (2024-11-20)81.76
14GPT-4.1 Mini78.53
15GPT-4o Mini (2024-07-18)77.06

Interactive version: theaggregate.ai/benchmark?slug=helm-vhelm-mme-celebrity · How It Works · Data refreshed daily, snapshot 2026-09-19.