RoboProcessBench - Current Primitive Recognition: leaderboard

RoboProcessBench (2026) asks vision-language models multiple-choice questions about how a robot manipulation is unfolding, using frames and short clips from held-out recordings of four robot datasets. This task asks which low-level primitive is being executed, from a short clip, with 4 options; accuracy in percent, higher is better.

Metric: Accuracy (%) on 359 questions asking which low-level primitive is being executed, from a short clip (4 options, chance 25.0); zero-shot multiple-choice VQA on held-out robot manipulation recordings from GM-100, RH20T, REASSEMBLE and AIST-Bimanual (ProcessData-Eval), temperature 0.01; higher is better. Source: arxiv.org. 14 models tracked.

Top models

#ModelScoreOverall rank
1GLM-4.6V34#701
2Qwen 2.5 VL 7B Instruct33.1#1833
3GPT-5.4 Mini32.1#389
4GPT-4o32#741
5InternVL3-8B31.2#1688
6Claude Sonnet 4.627.3#161
7InternVL3-38B26.2#903
8Claude Haiku 4.523.4#568

Interactive version: theaggregate.ai/benchmark?slug=roboprocessbench-current-primitive-recognition · How It Works · Data refreshed daily, snapshot 2026-11-13.