Act2Answer - Attribute: leaderboard
Metric: Soft success rate (%; 150 binary-choice items from MLLM-CompBench, 300 episodes; answer by placing a cube on the chosen image tile in a Simpler tabletop episode, original and left/right-swapped layouts, chance 50). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Magma-8B | 63 |
| 2 | Xiaomi-Robotics-R0 | 52 |
| 3 | OpenVLA | 51 |
| 4 | π0 | 50 |
| 5 | InternVLA-M1 | 49 |
| 6 | SpatialVLA | 48 |
Interactive version: theaggregate.ai/benchmark?slug=act2answer-attribute · How It Works · Data refreshed daily, snapshot 2026-09-25.