CP-SynC-XL - MiniZinc + OR-Tools: leaderboard
Metric: Correct instances (%; share of the 4,577 CP-SynC-XL instances of 100 CSPLib and PyCSP3 combinatorial problems whose returned solution passes the reference verifier (feasibility, COP optimality) within 256 s; declarative modelling: the LLM writes a MiniZinc model solved by OR-Tools CP-SAT, baseline prompt; final artefact after smoke and scaling-check refinement; greedy decoding). Source: arxiv.org. Saturation forecast: Around May 2027. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) (Medium) | 54.4 |
| 2 | DeepSeek V3.2 | 30 |
Interactive version: theaggregate.ai/benchmark?slug=cp-sync-xl-minizinc-plus-or-tools · How It Works · Data refreshed daily, snapshot 2026-09-26.