QuantCode-Bench - Backtest Pass: leaderboard
QuantCode-Bench (2026) tests whether language models turn textual trading strategy descriptions into Backtrader code that compiles, backtests on historical market data, trades and matches the described strategy. Share of tasks whose code compiles and backtests without runtime errors, in percent, from one attempt; higher is better.
Metric: Backtest pass rate (%), single turn: share of the tasks whose generated strategy compiles and runs the backtest without runtime errors, on QuantCode-Bench (400 Backtrader trading-strategy tasks from Reddit, TradingView, StackExchange, GitHub and synthetic sources, multi-timeframe historical data); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 98.2 | #114 |
| 2 | GPT-5.4 | 95.5 | #138 |
| 3 | GPT-5.2 Codex | 94.5 | #186 |
| 4 | GLM-5 | 92.4 | #276 |
| 5 | Claude Sonnet 4.5 | 91.5 | #267 |
| 6 | Kimi K2.5 | 87.3 | #272 |
| 7 | Claude Sonnet 4.6 | 85.8 | #179 |
| 8 | Gemini 3 Flash | 76 | #180 |
| 9 | DeepSeek V3.2 | 75.8 | #425 |
| 10 | Qwen 3 235B A22B | 72.5 | #633 |
| 11 | Grok 4.1 Fast | 70.2 | #431 |
| 12 | Qwen 3 Coder 30B A3B Instruct | 59 | #1022 |
| 13 | Gemini 2.5 Flash | 49.2 | #466 |
| 14 | Qwen 3 14B | 42.2 | #1284 |
| 15 | Qwen 3 8B | 31.8 | #1890 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=quantcode-bench-backtest-pass · How It Works · Data refreshed daily, snapshot 2026-11-22.