EvoCode-Bench - Single-Round: leaderboard

Metric: Single-round pass rate (SR, %): share of the 227 rounds solved in one attempt after Harbor fast-forwards the workspace to the reference solution of all earlier rounds, over the 26 stateful multi-round coding tasks of EvoCode-Bench (227 rounds, 5 to 15 per task, requirements that extend, correct or contradict earlier ones, cumulative executable verifiers), each model driving the Terminus-2 agent harness in a Harbor Docker workspace; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 13 models tracked.

Top models

#ModelScore
1Claude Opus 4.678.9
2Claude Opus 4.7 (High)76.7
3GPT-5.5 (High)74.4
4GLM-5.163.9
5Kimi K2.659
6Qwen 3.6 Plus (Thinking)57.3
7DeepSeek V4 Pro (High)56.4
8Gemini 3.1 Pro (Preview) (High)46.7
9DeepSeek V4 Flash (High)46.3
10Qwen 3.5 397B A17B44.1
11MiniMax-M2.730
12Seed 2.0 Pro (High)23.8

Interactive version: theaggregate.ai/benchmark?slug=evocode-bench-single-round · How It Works · Data refreshed daily, snapshot 2026-10-07.