HELM Reasoning - Reasoning Scenarios: leaderboard
The "Reasoning Scenarios" subtask of HELM Reasoning. Stanford HELM's reasoning project: competition mathematics, code and logical-reasoning scenarios (AIME, MATH, GPQA-style sets) run through the HELM harness with accuracy metrics.
Metric: Mean score. Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 11 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 Mini (2025-08-07) | 83.51 | #174 |
| 2 | Qwen 3 4B | 70.62 | #840 |
| 3 | Qwen 3 8B | 67.69 | #678 |
| 4 | Qwen 3 1.7B | 48.24 | #1200 |
| 5 | Qwen3-8B-Base | 29.42 | #628 |
| 6 | Qwen 3 0.6B | 24.62 | #1464 |
| 7 | Qwen3-4B-Base | 24.36 | #901 |
| 8 | Qwen3-1.7B-Base | 20.31 | #1189 |
| 9 | Qwen3-0.6B-Base | 14.56 | #1493 |
No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=helm-reasoning-reasoning-scenarios · How It Works · Data refreshed daily, snapshot 2026-10-23.