SysTradeBench - Execution Gate: leaderboard
Metric: Execution gate pass rate (%): share of the 12 strategies whose generated trading-system code executes in the sandboxed harness, one of six validity gates applied in order to each zero-shot (Iter0, temperature 0) submission of strategy card, executable code and audit log for 12 standardized trading-strategy specifications: parse, schema, execution, determinism, anti-leakage and audit; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 17 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.2 | 100 |
| 2 | GPT-5.1 | 100 |
| 3 | O3 | 100 |
| 4 | Grok 4 Fast | 100 |
| 5 | Claude Sonnet 4.5 | 91.7 |
| 6 | Grok 4.1 Fast (Reasoning) | 91.7 |
| 7 | GLM-4.6 | 91.7 |
| 8 | Grok 3 | 83.3 |
| 9 | Claude Opus 4.5 | 83.3 |
| 10 | Grok Code Fast 1 | 83.3 |
| 11 | Gemini 3 Pro | 75 |
| 12 | GLM-4.7 | 58.3 |
| 13 | Gemini 2.5 Pro | 50 |
| 14 | Gemini 3 Flash | 41.7 |
| 15 | Grok 4 | 25 |
Interactive version: theaggregate.ai/benchmark?slug=systradebench-execution-gate · How It Works · Data refreshed daily, snapshot 2026-10-07.