Causal-Plan-Bench: leaderboard

Metric: Overall score (0-100): macro-average of the 12 task scores, six four-choice accuracy (%) after answer normalization tasks and six open-ended tasks scored by rubric score (0-100): a blind GPT-5.6-sol judge scores each open-ended answer against a human-verified reference from 0 to 1, times 100; 100 held-out expert-reviewed items per task drawn from egocentric and robot video (EPIC-KITCHENS, Ego4D, HoloAssist and others), the same instruction, visual evidence and answer format for every model, temperature 0.2, mean of three regenerated runs; higher is better. Source: arxiv.org. Saturation forecast: Around 2035. 14 models tracked.

Top models

#ModelScore
1GPT-643.04
2Gemini 3.1 Pro (Preview)38.18
3Seed 2.1 Pro37.22
4GPT-5.6 Sol36.99
5Kimi K2.533.66
6Qwen 3 VL 8B Instruct33.23
7InternVL3.5-8B32.78
8GPT-4o32.58

Interactive version: theaggregate.ai/benchmark?slug=causal-plan-bench · How It Works · Data refreshed daily, snapshot 2026-09-29.