PaSBench-Video - Industrial: leaderboard

Metric: First-Act@1.0 (%) on the industrial production (46 risk videos, animated factory scenes): share of risk videos whose first warning, issued while the model streams 3-second windows of past frames only, lands between the annotated risk onset and 1 s before the accident and names the correct risk source; temperature 0, identical prompts; false positives on the no-risk split are not part of this score; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 13 models tracked.

Top models

#ModelScore
1Claude Sonnet 4.632.6
2GPT-5.4 Mini30.4
3Qwen 3.5 35B A3B28.3
4Claude Opus 4.726.1
5Qwen 3.5 27B26.1
6Qwen 3.5 4B23.9
7Gemma 4 31B23.9
8Qwen 3.5 9B21.7
9GPT-5.419.6
10Gemma 4 26B17.4
11Claude Haiku 4.54.3

Interactive version: theaggregate.ai/benchmark?slug=pasbench-video-industrial · How It Works · Data refreshed daily, snapshot 2026-09-29.