FullStackBench (2024-12 bilingual): leaderboard

FullStackBench December 2024 executable code-generation release: 3,374 problems split equally between English and Chinese, across 16 programming languages and 11 main application domains. Pass@1 is reproduced from the publisher's per-problem accepted outcomes; kept separate from language-specific runs.

Metric: Pass@1 (%), 3,374 problems: 1,687 English and 1,687 Chinese; December 2024 release. Source: github.com. Saturation forecast: Estimated already saturated. 27 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1O1 Preview65.62#477
2O1 Mini64.73#760
3Claude 3.5 Sonnet62.57#755
4GPT-4o (2024-08-06)61.77#750
5Doubao-Coder-Preview58.92
6DeepSeek Coder V2 Instruct58.09#992
7Qwen 2.5 72B Instruct56.88#1124
8Qwen 2.5 Coder 32B Instruct56.88#1590
9GLM-4 Plus56.4#1045
10Qwen 2.5 Coder 14B Instruct55.28#1842
11Qwen Max55.16#1094
12Llama 3.1 70B Instruct51.45#1579
13DeepSeek Coder V2 Lite Instruct48.73#3823
14DeepSeek-Coder-33B-Instruct48.61#2592
15Qwen 2.5 Coder 7B Instruct47.95#3976

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=fullstackbench-2024-12-bilingual · How It Works · Data refreshed daily, snapshot 2026-11-22.