FrontierCS 2 - EVM State Checkpoints: leaderboard

FrontierCS 2 selected formal runs on 48 research engineering tasks, with each source-native coding harness. Paper v1 Table 3 fixes the effort settings; the subsequently added DeepSeek 1017 row leaves effort unspecified. Superseded attempts are not selected by score. Native bounded task scores are distinct from human-reference margins and from pass/fail verdicts. Explicit failed-run zeroes remain zero; unreported scores remain missing. Metric: Task score (0–100).

Metric: Task score (0–100). Source: frontier-cs.org. Saturation forecast: Around January 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.5 (Max)88.53#5 (Claude Opus 5.5)
2Muse Wonder (Max)80.56#15 (Muse Wonder)
3DeepSeek V4.1 Flash (Max)80.32#35 (DeepSeek V4.1 Flash)
4GLM-5.3 (Max)78.62#39 (GLM-5.3)
5GPT-6.1 Sol (xHigh)75.81#7 (GPT-6.1 Sol)
6GPT-6 Astra (xHigh)74.95#6 (GPT-6 Astra)
7Kimi K3 (High)9.12#33 (Kimi K3)
8GLM-5.3 Flash (Max)3.47#72 (GLM-5.3 Flash)
9Gemini 4 Argon (High)2.3#8 (Gemini 4 Argon)
10Muse Spark 1.3 (High)2.29#29 (Muse Spark 1.3)
11DeepSeek V4.1 Flash (1017)0#27

No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=frontiercs-2-evm-state-checkpoints · How It Works · Data refreshed daily, snapshot 2026-10-26.