Co-Design Bench - Repository Editing: leaderboard
Co-Design Bench (arXiv 2610.35138) gives a coding agent an existing, runnable web application and a real user's change request, sometimes with an annotated screenshot, image, audio, video or document, and checks whether the revised application meets every requirement. Its 273 tasks come from real coding sessions: 100 Multimodal Editing tasks on a single page and 173 Repository Editing tasks across a multi-file frontend repository, with 2,331 expert-written acceptance criteria hidden from the agent. All ten model endpoints run in the same Claude Code harness; an LLM judge marks each criterion pass, partial or fail from the source and the rendered page, and a second verifier can downgrade positive verdicts. Unlike SWE-bench, which accepts a patch when the repository's unit tests pass, there is no gold patch, test suite or target screenshot. This board is Strict completion on the 173 Repository Editing tasks.
Metric: Strict completion on the 173 Repository Editing tasks (%). Source: codesignbench.github.io. Saturation forecast: Around November 2028. 10 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 66.7 | #6 |
| 2 | Qwen 3.8 27B | 64.5 | #199 |
| 3 | Qwen 3.8 Max (0902) | 64.4 | #49 |
| 4 | Claude Opus 5 | 64.2 | #20 |
| 5 | GPT-5.6 Sol | 62.7 | #29 |
| 6 | Kimi K3 | 61 | #53 |
| 7 | GLM-5.3 Flash | 59.4 | #119 |
| 8 | Claude Opus 4.8 | 57.5 | #56 |
| 9 | GLM-5.2 | 56.4 | #137 |
| 10 | Grok 4.6 | 53.6 | #44 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=co-design-bench-repository-editing · How It Works · Data refreshed daily, snapshot 2026-11-12.