QuantCode-Bench (Agentic): leaderboard
QuantCode-Bench (2026) tests whether language models turn textual trading strategy descriptions into Backtrader code that compiles, backtests on historical market data, trades and matches the described strategy. Share of tasks passing every check within up to ten attempts with error feedback, in percent; higher is better.
Metric: Judge pass rate (%) within up to 10 attempts, each failed attempt returned to the model with its error type and system message, on QuantCode-Bench (400 Backtrader trading-strategy tasks from Reddit, TradingView, StackExchange, GitHub and synthetic sources, multi-timeframe historical data); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 97.5 | #114 |
| 2 | Claude Sonnet 4.6 | 96 | #179 |
| 3 | GPT-5.4 | 95 | #138 |
| 4 | Kimi K2.5 | 93.5 | #272 |
| 5 | Claude Sonnet 4.5 | 93 | #267 |
| 6 | Gemini 3 Flash | 91.8 | #180 |
| 7 | GLM-5 | 90.8 | #276 |
| 8 | GPT-5.2 Codex | 89.8 | #186 |
| 9 | Qwen 3 235B A22B | 87.2 | #633 |
| 10 | Grok 4.1 Fast | 84.5 | #431 |
| 11 | DeepSeek V3.2 | 83.8 | #425 |
| 12 | Qwen 3 Coder 30B A3B Instruct | 68 | #1022 |
| 13 | Qwen 3 14B | 62.7 | #1284 |
| 14 | Gemini 2.5 Flash | 62.5 | #466 |
| 15 | Qwen 3 8B | 47.6 | #1890 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=quantcode-bench-agentic · How It Works · Data refreshed daily, snapshot 2026-11-22.