QuantCode-Bench - Backtest Pass: leaderboard

QuantCode-Bench (2026) tests whether language models turn textual trading strategy descriptions into Backtrader code that compiles, backtests on historical market data, trades and matches the described strategy. Share of tasks whose code compiles and backtests without runtime errors, in percent, from one attempt; higher is better.

Metric: Backtest pass rate (%), single turn: share of the tasks whose generated strategy compiles and runs the backtest without runtime errors, on QuantCode-Bench (400 Backtrader trading-strategy tasks from Reddit, TradingView, StackExchange, GitHub and synthetic sources, multi-timeframe historical data); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Opus 4.698.2#114
2GPT-5.495.5#138
3GPT-5.2 Codex94.5#186
4GLM-592.4#276
5Claude Sonnet 4.591.5#267
6Kimi K2.587.3#272
7Claude Sonnet 4.685.8#179
8Gemini 3 Flash76#180
9DeepSeek V3.275.8#425
10Qwen 3 235B A22B72.5#633
11Grok 4.1 Fast70.2#431
12Qwen 3 Coder 30B A3B Instruct59#1022
13Gemini 2.5 Flash49.2#466
14Qwen 3 14B42.2#1284
15Qwen 3 8B31.8#1890

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=quantcode-bench-backtest-pass · How It Works · Data refreshed daily, snapshot 2026-11-22.