FrontierCS 2 - Approximate-MIPS Query Stopping: leaderboard

FrontierCS 2 selected formal runs on 48 research engineering tasks, with each source-native coding harness. Paper v1 Table 3 fixes the effort settings; the subsequently added DeepSeek 1017 row leaves effort unspecified. Superseded attempts are not selected by score. Native bounded task scores are distinct from human-reference margins and from pass/fail verdicts. Explicit failed-run zeroes remain zero; unreported scores remain missing. Metric: Task score (0–100).

Metric: Task score (0–100). Source: frontier-cs.org. Saturation forecast: Not forecast. 14 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.3 (Max)86.73#39 (GLM-5.3)
2Kimi K3 (High)85.53#33 (Kimi K3)
3Muse Spark 1.3 (High)85.53#29 (Muse Spark 1.3)
4DeepSeek V4.1 Flash (1017)82.39#27
5Claude Opus 5.5 (Max)81.81#5 (Claude Opus 5.5)
6GPT-6.1 Sol (xHigh)81.67#7 (GPT-6.1 Sol)
7GPT-6 Astra (xHigh)81.51#6 (GPT-6 Astra)
8Gemini 4 Argon (High)81.3#8 (Gemini 4 Argon)
9Muse Wonder (Max)81.11#15 (Muse Wonder)
10GLM-5.3 Flash (Max)64.43#72 (GLM-5.3 Flash)
11DeepSeek V4.1 Flash (Max)0#35 (DeepSeek V4.1 Flash)

No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=frontiercs-2-approximate-mips-query-stopping · How It Works · Data refreshed daily, snapshot 2026-10-26.