Prim - Execution: leaderboard

Prim's execution score: exact-match accuracy on 182 Humanity's Last Exam mathematics problems when the gold mathematical primitive (the solution's key idea) is supplied with the problem; higher is better (Prim, 2026).

Metric: Execution accuracy (%): exact-match accuracy on the 182 problems when the gold mathematical primitive is given with the problem; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 4 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.4High86.81#138
2Qwen 3.6 27B78.57#352
3Qwen 3.5 27B71.98#378
4GPT-5.4 MiniHigh71.98#405
5GPT-5.4 NanoHigh68.68#651
6Qwen 3.5 9B61.54#829
7GPT-OSS-20BHigh60.99#1166
8Qwen 3.5 4B56.04#1235
9DeepSeek R1 Distill Qwen 32B43.41#1813
10DeepSeek R1 0528 Qwen3 8B39.56#2190
11DeepSeek R1 Distill Qwen 14B39.01#2706
12DeepSeek-R1-Distill-Qwen-7B32.42#7912

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=prim-execution · How It Works · Data refreshed daily, snapshot 2026-11-20.