McEval: leaderboard

McEval: Measures model capability on programming, code generation, code repair, or repository-level software tasks.

Metric: AVG (%). Source: github.com. Source: benchmarklist.com. Saturation forecast: Estimated already saturated. 22 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4 Turbo63.4#404
2GPT-3.5 Turbo52.6#865
3Codestral-22B-v0.150.5#911
4Magicoder-S-DS-6.7B48.6#1256
5CodeQwen1.5-7B45.5#1514
6Nxcode-CQ-7B-orpo44.7#1477
7Llama 3 8B Instruct36#1129
8Qwen 1.5 72B Chat35.8#776
9Phi-3-medium-4k-instruct35.2#952
10WizardCoder-15B-V1.028#1588

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mceval · How It Works · Data refreshed daily, snapshot 2026-10-20.