PECC - Project Euler (Story): leaderboard

The Project Euler (Story) track of PECC (arXiv) — Project Euler problems wrapped in narrative prose; solve rate (%).

Metric: Solve rate (%). Source: huggingface.co. Saturation forecast: Around January 2028. 11 models tracked.

Top models

#ModelScoreOverall rank
1GPT-3.5 Turbo6.95#865
2Mixtral 8x7B Instruct (v0.1)2.23#1073
3Phi-3 Mini 128K Instruct2.23#1298
4WizardLM-2-7B0.87#1395
5Mistral Instruct v0.1 7B0.12#1454
6Llama 3 8B Instruct0#1129

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=pecc-project-euler-story · How It Works · Data refreshed daily, snapshot 2026-10-20.