SysTradeBench - Audit Gate: leaderboard

Audit gate of SysTradeBench (2026), the last of six validity gates (parse, schema, execution, determinism, anti-leakage, audit) applied to zero-shot submissions for 12 standardized trading-strategy specifications: the share of strategies whose run also emits complete signal, risk, order, position and profit audit logs. Pass rate in percent; higher is better.

Metric: Audit gate pass rate (%): share of the 12 strategies whose submission produces complete mandatory audit logs (signal, risk check, order, position and P&L trace), the last and strictest of six validity gates applied in order to each zero-shot (Iter0, temperature 0) submission of strategy card, executable code and audit log for 12 standardized trading-strategy specifications: parse, schema, execution, determinism, anti-leakage and audit; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-5.2100#185
2GPT-5.1100#240
3O3100#237
4GLM-4.691.7#498
5Grok 4 Fast91.7#447
6SysTradeBench DeepSeek-V3 (checkpoint unspecified)91.7
7Claude Sonnet 4.583.3#261
8Grok 383.3#611
9Grok 4.1 FastReasoning83.3#427
10Grok Code Fast 183.3#703
11Claude Opus 4.575#160
12Gemini 3 Pro66.7#145
13GLM-4.750#380
14Gemini 2.5 Pro33.3#276
15Gemini 3 Flash33.3#175

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=systradebench-audit-gate · How It Works · Data refreshed daily, snapshot 2026-11-21.