PaSBench-Video - Daily Life: leaderboard

PaSBench-Video (2026) streams videos to multimodal models, which see only past frames in 3-second windows and must decide when to issue a safety warning before an accident. This board covers 201 daily life and home monitoring risk videos. The score is First-Act at a 1-second lead time in percent: the first warning must fall between the annotated risk onset and 1 second before the accident and name the correct risk source; higher is better, and false alarms on safe videos are not part of the score.

Metric: First-Act@1.0 (%) on the daily life and home monitoring (201 risk videos from OOPS, Smarthome and RadSV): share of risk videos whose first warning, issued while the model streams 3-second windows of past frames only, lands between the annotated risk onset and 1 s before the accident and names the correct risk source; temperature 0, identical prompts; false positives on the no-risk split are not part of this score; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.719.9#79
2Qwen 3.5 35B A3B15.9#482
3Qwen 3.5 27B15.4#359
4Claude Sonnet 4.613.4#161
5GPT-5.412.4#123
6Qwen 3.5 9B11.4#803
7Qwen 3.5 4B11.4#1175
8Gemma 4 31B9.5#394
9Gemma 4 26B6#612
10Claude Haiku 4.55.5#568
11GPT-5.4 Mini4#389

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=pasbench-video-daily-life · How It Works · Data refreshed daily, snapshot 2026-11-13.