AsyncPlan-XXL (CP-SAT Formalizer): leaderboard
Metric: Plan accuracy (%; mean over the 12 AsyncPlan-XXL graph sizes (5 to 100 actions, 50 instances each) of the share of schedules that satisfy every duration and precedence constraint and reach the optimal makespan; the LLM writes a CP-SAT constraint program that OR-Tools solves (CP-SAT Formalizer); zero-shot, temperature 0). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash | 98 |
| 2 | DeepSeek V4 Flash | 97 |
| 3 | Qwen 3.6 35B A3B | 96 |
| 4 | GPT-5 Mini | 86 |
Interactive version: theaggregate.ai/benchmark?slug=asyncplan-xxl-cp-sat-formalizer · How It Works · Data refreshed daily, snapshot 2026-09-26.