SysTradeBench - Audit Gate: leaderboard
Audit gate of SysTradeBench (2026), the last of six validity gates (parse, schema, execution, determinism, anti-leakage, audit) applied to zero-shot submissions for 12 standardized trading-strategy specifications: the share of strategies whose run also emits complete signal, risk, order, position and profit audit logs. Pass rate in percent; higher is better.
Metric: Audit gate pass rate (%): share of the 12 strategies whose submission produces complete mandatory audit logs (signal, risk check, order, position and P&L trace), the last and strictest of six validity gates applied in order to each zero-shot (Iter0, temperature 0) submission of strategy card, executable code and audit log for 12 standardized trading-strategy specifications: parse, schema, execution, determinism, anti-leakage and audit; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-5.2 | 100 | #185 | |
| 2 | GPT-5.1 | 100 | #240 | |
| 3 | O3 | 100 | #237 | |
| 4 | GLM-4.6 | 91.7 | #498 | |
| 5 | Grok 4 Fast | 91.7 | #447 | |
| 6 | SysTradeBench DeepSeek-V3 (checkpoint unspecified) | 91.7 | ||
| 7 | Claude Sonnet 4.5 | 83.3 | #261 | |
| 8 | Grok 3 | 83.3 | #611 | |
| 9 | Grok 4.1 Fast | Reasoning | 83.3 | #427 |
| 10 | Grok Code Fast 1 | 83.3 | #703 | |
| 11 | Claude Opus 4.5 | 75 | #160 | |
| 12 | Gemini 3 Pro | 66.7 | #145 | |
| 13 | GLM-4.7 | 50 | #380 | |
| 14 | Gemini 2.5 Pro | 33.3 | #276 | |
| 15 | Gemini 3 Flash | 33.3 | #175 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=systradebench-audit-gate · How It Works · Data refreshed daily, snapshot 2026-11-21.