QuantCode-Bench: leaderboard
QuantCode-Bench (2026) tests whether language models turn textual trading strategy descriptions into Backtrader code that compiles, backtests on historical market data, trades and matches the described strategy. Share of tasks passing every check including an LLM judgment of faithfulness, in percent, from one attempt; higher is better.
Metric: Judge pass rate (%), single turn: share of the tasks whose generated strategy compiles, backtests without runtime errors, places at least one trade and is judged by an LLM to implement the described strategy, on QuantCode-Bench (400 Backtrader trading-strategy tasks from Reddit, TradingView, StackExchange, GitHub and synthetic sources, multi-timeframe historical data); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 75.8 | #113 |
| 2 | GPT-5.4 | 70.2 | #135 |
| 3 | Claude Sonnet 4.5 | 69.8 | #261 |
| 4 | GPT-5.2 Codex | 67.5 | #182 |
| 5 | GLM-5 | 65.4 | #269 |
| 6 | Claude Sonnet 4.6 | 65 | #173 |
| 7 | Kimi K2.5 | 64.8 | #266 |
| 8 | Gemini 3 Flash | 59.8 | #175 |
| 9 | Grok 4.1 Fast | 48.9 | #427 |
| 10 | DeepSeek V3.2 | 48.8 | #419 |
| 11 | Qwen 3 235B A22B | 48.2 | #628 |
| 12 | Qwen 3 Coder 30B A3B Instruct | 39.2 | #1012 |
| 13 | Gemini 2.5 Flash | 31.2 | #463 |
| 14 | Qwen 3 14B | 25.2 | #1269 |
| 15 | Qwen 3 8B | 18.5 | #1873 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=quantcode-bench · How It Works · Data refreshed daily, snapshot 2026-11-21.