HELM v2 Lite - HumanEval (Code) — leaderboard
Metric: Pass@1 (%). Source: nlp.stanford.edu. 18 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4 (0613) | 73 |
| 2 | text-davinci-003 | 55 |
| 3 | text-davinci-002 | 36 |
| 4 | Yi 34B (Base) | 30 |
| 5 | PaLM-2 (Bison) | 29 |
| 6 | LLaMA-65B | 26 |
| 7 | Llama 2 70B | 23 |
| 8 | GPT-3.5 Turbo (0613) | 22 |
| 9 | Mistral-7B-v0.1 | 19 |
| 10 | Yi 6B (Chat) | 16 |
| 11 | Llama 2 13B | 11 |
| 12 | Llama 2 7B | 9 |
| 13 | Palmyra X V3 (72B) | 2 |
| 14 | falcon-7B | 0 |
| 15 | GPT-4 Preview (1106) | 0 |
Interactive version: theaggregate.ai/benchmark?slug=helm-v2-lite-humaneval-code · How the rankings work · Data refreshed daily, snapshot 2026-07-22.