HELM Classic - HumanEval (Code): leaderboard
The "HumanEval (Code)" subtask of HELM Classic. A scenario from Stanford HELM Classic, the holistic evaluation suite scoring language models across accuracy, robustness and calibration on a broad set of tasks.
Metric: Pass@1 (%). Source: crfm.stanford.edu. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | code-davinci-002 | 46.34 | |
| 2 | code-cushman-001 (12B) | 31.71 |
Interactive version: theaggregate.ai/benchmark?slug=helm-classic-humaneval-code · How It Works · Data refreshed daily, snapshot 2026-10-20.