OR-Space: leaderboard

Large language model (LLM) agents are increasingly used to assist with operations research (OR) modeling, yet existing OR-oriented benchmarks often reduce evaluation to one-shot translation from a self-contained problem statement into a mathematical formulation or solver program. Such settings abstract away two characteristics of real industrial OR workflows: persistent multi-artifact workspaces a

Metric: Build Pass@1 (self-reported). Source: benchmarklist.com. Saturation forecast: Around June 2027. 19 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)72#58
2Gemini 3 Flash68#99
3DeepSeek V4 Pro67#102
4Claude Opus 4.662#63
5GPT-5.459#79
6GPT-5 Mini58#186
7DeepSeek R1 052855#222
8DeepSeek V4 Flash54#137
9Gemini 2.5 Flash53#245
10Claude Sonnet 4.553#142
11GPT-5.153#135
12Claude Sonnet 4.5 (Thinking)53#142 (Claude Sonnet 4.5)
13Qwen 3 Max49#208
14Gemini 2.5 Pro47#152
15Qwen 3 32B32#443

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=or-space · How It Works · Data refreshed daily, snapshot 2026-10-20.