HELM v2 Lite - MedQA — leaderboard
Metric: Exact Match (%). Source: nlp.stanford.edu. 21 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4 (0613) | 88.46 |
| 2 | GPT-4 Preview (1106) | 86.54 |
| 3 | Palmyra X V3 (72B) | 76.92 |
| 4 | PaLM-2 (Unicorn) | 76.92 |
| 5 | Yi 34B (Base) | 73.08 |
| 6 | Claude 2 | 71.15 |
| 7 | Claude 2.1 | 69.23 |
| 8 | PaLM-2 (Bison) | 67.31 |
| 9 | Palmyra X V2 (33B) | 67.31 |
| 10 | Llama 2 70B | 65.38 |
| 11 | Yi 6B (Chat) | 61.54 |
| 12 | Mistral-7B-v0.1 | 59.62 |
| 13 | GPT-3.5 Turbo (0613) | 59.62 |
| 14 | text-davinci-003 | 55.77 |
| 15 | text-davinci-002 | 55.77 |
Interactive version: theaggregate.ai/benchmark?slug=helm-v2-lite-medqa · How the rankings work · Data refreshed daily, snapshot 2026-07-22.