MERA Code - CodeCorrectness: leaderboard

MERA Code (Russian) CodeCorrectness task: judging whether a snippet is correct, rather than writing one. Each task keeps its own metric — pass rates, CodeBLEU and chrF all appear across this suite — so read the metric label before comparing boards.

Metric: Accuracy (%). Source: mera.a-ai.ru. Saturation forecast: Not forecast. 66 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.494.27#79
2GPT-5.1 Codex Max91.33#100
3Kimi K2.589.64#144
4Qwen 3.6 27B87.44#170
5GLM-5.186.77#97
6Claude Opus 4.685.89#63
7Qwen 3.6 35B A3B84.94#226
8LFM2.5-1.2B Instruct84.5#1462
9Qwen 3 32B84.13#443
10Qwen 2.5 1.5B Instruct83.69#1407
11Qwen 3 30B A3B 2507 (Thinking)82.95#376 (Qwen 3 30B A3B 2507)
12Qwen 2.5 0.5B Instruct82.73#1529
13LFM2 8B A1B82.59#1263
14OLMo 3 7B Instruct81.56#1218
15LFM2 24B A2B81.26#1379

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mera-code-codecorrectness · How It Works · Data refreshed daily, snapshot 2026-10-20.