LabRobFail-Bench - Task Understanding: leaderboard
Metric: Top-1 accuracy (%; decomposing the video into its atomic lab actions; robot-manipulation videos from simulated chemical self-driving laboratories with injected control, physics and semantic failures, seen-environment test split; answers from simulator ground truth; zero-shot VLM). Source: arxiv.org. Saturation forecast: Around June 2027. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.4 | 45.16 |
| 2 | Gemini 2.5 Flash | 38.92 |
| 3 | Gemini 2.0 Flash | 26.98 |
Interactive version: theaggregate.ai/benchmark?slug=labrobfail-bench-task-understanding · How It Works · Data refreshed daily, snapshot 2026-09-29.