DynaSchedBench: leaderboard

DynaSchedBench (2026) tests LLMs as step-by-step dispatching agents on calibrated dynamic flexible job shop scheduling instances with random job arrivals, machine breakdowns and uncertain processing times. The score is the mean makespan gap, in percent, to the best schedule observed on each instance across all LLMs and fixed dispatching rules, so lower is better and 0 is the floor.

Metric: Mean relative makespan gap (%): makespan above the best schedule observed for the same instance (all LLMs and 24 fixed priority dispatching rules), averaged over the 70-instance DynaSched-Subset of calibrated dynamic flexible job shop instances; LLM dispatches step by step with the L1 local observation, direct answer, two few-shot examples, temperature 0; 0 means matching the best schedule on every instance and there is no upper limit; lower is better. Source: arxiv.org. Saturation forecast: Not forecast. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3 8B1.01#1873
2Qwen 3 14B1.34#1269
3Qwen 3 4B1.45#2348
4Kimi K21.46#443
5Claude Haiku 4.51.52#583
6Qwen 3 32B1.65#972
7DeepSeek V3.21.68#419
8Gemini 2.5 Flash Lite1.76#964
9Grok 4 Fast1.88#447
10GPT-5 Mini1.93#364

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=dynaschedbench · How It Works · Data refreshed daily, snapshot 2026-11-21.