AsyncPlan Robo Challenge (PDDL2.1 Formalizer): leaderboard
Metric: Plan accuracy (%; share of the 140 Robo Challenge kitchen tasks (seven splits of 20 built on Robotouille, with object states, resources, stations and multiple agents) whose plan is valid and reaches the optimal makespan; the LLM writes PDDL2.1 domain and problem files that the OPTIC temporal planner solves (PDDL2.1 Formalizer); zero-shot, temperature 0). Source: arxiv.org. Saturation forecast: Around 2029. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3.6 35B A3B | 67.9 |
| 2 | GPT-5 Mini | 55.7 |
| 3 | Gemini 3 Flash | 52.9 |
| 4 | DeepSeek V4 Flash | 27.9 |
Interactive version: theaggregate.ai/benchmark?slug=asyncplan-robo-challenge-pddl2-1-formalizer · How It Works · Data refreshed daily, snapshot 2026-09-26.