QuantCode-Bench (Agentic): leaderboard

QuantCode-Bench (2026) tests whether language models turn textual trading strategy descriptions into Backtrader code that compiles, backtests on historical market data, trades and matches the described strategy. Share of tasks passing every check within up to ten attempts with error feedback, in percent; higher is better.

Metric: Judge pass rate (%) within up to 10 attempts, each failed attempt returned to the model with its error type and system message, on QuantCode-Bench (400 Backtrader trading-strategy tasks from Reddit, TradingView, StackExchange, GitHub and synthetic sources, multi-timeframe historical data); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Opus 4.697.5#114
2Claude Sonnet 4.696#179
3GPT-5.495#138
4Kimi K2.593.5#272
5Claude Sonnet 4.593#267
6Gemini 3 Flash91.8#180
7GLM-590.8#276
8GPT-5.2 Codex89.8#186
9Qwen 3 235B A22B87.2#633
10Grok 4.1 Fast84.5#431
11DeepSeek V3.283.8#425
12Qwen 3 Coder 30B A3B Instruct68#1022
13Qwen 3 14B62.7#1284
14Gemini 2.5 Flash62.5#466
15Qwen 3 8B47.6#1890

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=quantcode-bench-agentic · How It Works · Data refreshed daily, snapshot 2026-11-22.