JamBench - Script Completion (Small Projects, Claude Code): leaderboard
JamBench (2026) tests project-level game programming on the Godot engine with real Game Jam projects; outputs are checked deterministically in headless mode, and the board is the percentage of projects that compile and then run for 30 seconds without crashing. In this completion task on small projects (under 4K lines), 30 to 50% of the .gd script files are removed and must be rewritten, with the model working inside the Claude Code agent harness; higher is better.
Metric: L3a runtime pass rate (%): share of generated Godot 4 projects that pass file-integrity and headless compilation checks and then run 30 seconds in headless mode without crashing; Task 2 code completion: 100 benchmark projects with small code bases (under 4K lines), each manually verified playable; 30 to 50% of the .gd script files are removed and must be rewritten; Claude Code as the agent harness, iterating with the Godot toolchain; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V4 Pro | 95 | #188 |
| 2 | Claude Opus 4.6 | 94 | #102 |
| 3 | Qwen 3.5 397B A17B | 92 | #246 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=jambench-script-completion-small-projects-claude-code · How It Works · Data refreshed daily, snapshot 2026-11-13.