LabRobFail-Bench - Failure Detection: leaderboard
Metric: Top-1 accuracy (%; binary detection of whether the trajectory contains a failure; robot-manipulation videos from simulated chemical self-driving laboratories with injected control, physics and semantic failures, seen-environment test split; answers from simulator ground truth; zero-shot VLM). Source: arxiv.org. Saturation forecast: Around 2028. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash | 57.13 |
| 2 | Gemini 2.0 Flash | 56.85 |
| 3 | GPT-5.4 | 52.34 |
Interactive version: theaggregate.ai/benchmark?slug=labrobfail-bench-failure-detection · How It Works · Data refreshed daily, snapshot 2026-09-29.