TCSExam-Lite: leaderboard
TCSExam (Moonshot AI) evaluates model-agent systems on verifiable theoretical computer science research: Lean proofs of results from recent TCS papers, reusable solvers judged on hidden instances, explicit constructions verified in Lean, and open conjectures. Unlike PutnamBench or miniF2F, which formalize competition problems, its theorems come from research papers and its solver and construction tracks are scored against published best-known results. Agent harness, version and reasoning setting per model follow the paper's Table 9 (arXiv 2611.07962v1). Question access: task statements and checkers are public on GitHub; solver judging uses hidden instances. Lite suite: 20 of the Full tasks, five per track; Offline Solver protocol with public self-tests during development and one final hidden-instance evaluation. TCSExam Index = 30 x theorem success + 30 x Kimi K3-relative solver score + 30 x construction score + 10 x open-conjecture success, in points; construction scores are unclipped, so the Index can exceed 100. The few nonzero open-conjecture results adapt counterexamples OpenAI published after task selection.
Metric: TCSExam Index (points; may exceed 100). Source: moonshotai.github.io. Saturation forecast: Rough model projection: around 2026. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5.5 (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Claude Code 2.1.283; 1M-token context option; effort=max) | 72.27 | |
| 2 | GPT-6 Astra (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Codex 0.154.0; effort=max) | 67.03 | |
| 3 | Kimi K3.1 Pro (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Kimi Code 0.43.0; effort=max) | 53.49 | |
| 4 | Kimi K3 (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Kimi Code 0.43.0; effort=max) | 48.61 | |
| 5 | GLM-5.3 (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Claude Code 2.1.257; effort=max) | 47.04 | |
| 6 | Qwen 3.8 Max (0902) (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Claude Code 2.1.257; effort=max) | 45.38 | |
| 7 | DeepSeek V4.1 Flash (1017) (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Claude Code 2.1.257; effort=max) | 42.37 | |
| 8 | Grok 4.6 (Benchmark Sweep Run: source=TCSExam; suite=lite; harness=Grok Build 1.0.41; thinking on; effort=xhigh) | 42.07 |
Interactive version: theaggregate.ai/benchmark?slug=tcsexam-lite · How It Works · Data refreshed daily, snapshot 2026-11-12.