VA-Bench - Single-Arm: leaderboard

The 11 single-arm task families of VA-Bench (Zhang et al., 2026), in which a general-purpose multimodal model learns a manipulation task from an RGB-only expert video, chooses camera viewpoints and issues metric arm commands for a fixed controller. Terminal task success in percent, macro-averaged over the families with 20 seeds each and averaged over three runs; higher is better.

Metric: Task success (%; the 11 single-arm base task families; 20 physically verified seeds per task family in RoboTwin simulation; the model watches an RGB-only expert video, writes its own task summary, chooses camera viewpoints and issues metric Cartesian arm commands that a fixed model-agnostic controller executes, with execution feedback; terminal success from the environment checker; task-family macro-average, mean of three runs). Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.8 Max65.61#55
2Claude Opus 564.09#20
3GPT-5.6 Sol59.55#29
4GPT-5.6 Terra29.24#60
5Seed 2.1 Turbo19.09#156
6Gemini 3.6 Flash18.03#72
7GPT-5.6 Luna17.42#117
8Claude Sonnet 511.52#108
9Qwen 3.7 Max10.3#142
10Qwen 3.7 Plus9.09#203
11MiniMax-M35.15#265
12MiMo-V2.54.24#353

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=va-bench-single-arm · How It Works · Data refreshed daily, snapshot 2026-11-12.