FrontierCS 2 - GPU IVF-PQ Search Kernel Optimization: leaderboard
FrontierCS 2 selected formal runs on 48 research engineering tasks, with each source-native coding harness. Paper v1 Table 3 fixes the effort settings; the subsequently added DeepSeek 1017 row leaves effort unspecified. Superseded attempts are not selected by score. Native bounded task scores are distinct from human-reference margins and from pass/fail verdicts. Explicit failed-run zeroes remain zero; unreported scores remain missing. Metric: Task score (0–100).
Metric: Task score (0–100). Source: frontier-cs.org. Saturation forecast: Around March 2028. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5.5 (Max) | 80.54 | #5 (Claude Opus 5.5) |
| 2 | Gemini 4 Argon (High) | 79.83 | #8 (Gemini 4 Argon) |
| 3 | GPT-6.1 Sol (xHigh) | 79.35 | #7 (GPT-6.1 Sol) |
| 4 | Kimi K3 (High) | 79.1 | #33 (Kimi K3) |
| 5 | GLM-5.3 (Max) | 78.72 | #39 (GLM-5.3) |
| 6 | DeepSeek V4.1 Flash (Max) | 78.66 | #35 (DeepSeek V4.1 Flash) |
| 7 | GPT-6 Astra (xHigh) | 78.18 | #6 (GPT-6 Astra) |
| 8 | Muse Wonder (Max) | 78.13 | #15 (Muse Wonder) |
| 9 | GLM-5.3 Flash (Max) | 76.69 | #72 (GLM-5.3 Flash) |
| 10 | DeepSeek V4.1 Flash (1017) | 74.07 | #27 |
| 11 | Muse Spark 1.3 (High) | 70.15 | #29 (Muse Spark 1.3) |
No result here: #9 Claude Fable 5.1, #10 Muse Wonder Full.
Interactive version: theaggregate.ai/benchmark?slug=frontiercs-2-gpu-ivf-pq-search-kernel-optimization · How It Works · Data refreshed daily, snapshot 2026-10-26.