HELM MedHELM - DischargeMe: leaderboard

HELM MedHELM DischargeMe task, generating patient-friendly discharge instructions from hospital records.

Metric: Jury Score. Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScoreOverall rank
1GPT-54.67#98
2GPT-5 Mini (2025-08-07)4.57#172
3O4 Mini (2025-04-16)4.47#179
4DeepSeek R14.3#251
5O3 Mini (2025-01-31)4.29#240
6Gemini 2.5 Pro (Preview 05-06)4.29#147
7Claude 3.5 Sonnet (20241022)3.83#291
8Claude 3.7 Sonnet (20250219)3.8#201
9GPT-4o Mini (2024-07-18)3.69#558
10Gemini 1.5 Pro (001)3.62#444
11GPT-4o (2024-05-13)3.58#325
12Llama 3.3 70B Instruct3.57#534
13Gemini 2.0 Flash3.45#342

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-medhelm-dischargeme · How It Works · Data refreshed daily, snapshot 2026-10-20.