MERA Code - UnitTests: leaderboard

MERA Code (Russian) UnitTests task: writing unit tests that actually exercise the supplied behaviour. Each task keeps its own metric — pass rates, CodeBLEU and chrF all appear across this suite — so read the metric label before comparing boards.

Metric: CodeBLEU (%). Source: mera.a-ai.ru. Saturation forecast: Around 2033. 66 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.534.21#144
2GLM-5.133.23#97
3GPT-5.1 Codex Max32.31#100
4GPT-5.432.1#79
5DeepSeek V4 Flash31.95#137
6DeepSeek V4 Pro31.8#102
7Qwen 3.6 35B A3B30.46#226
8Qwen 3 32B30.28#443
9Qwen 3 14B30#537
10Claude Opus 4.629.92#63
11Qwen 3 30B A3B 2507 (Thinking)28.75#376 (Qwen 3 30B A3B 2507)
12Qwen 3.6 27B28.31#170
13Qwen 3.5 2B26.57#1148
14Qwen 3 8B26.52#674
15Qwen 3 Next 80B A3B (Thinking)26.51#320 (Qwen 3 Next 80B A3B)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mera-code-unittests · How It Works · Data refreshed daily, snapshot 2026-10-20.