VideoChat-R1.5-7B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1580 ± 33, rank #1248 of 10916 rated models, from 45 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
TOC-Bench - Reappearance Identity100Reappearance Identity accuracy (%) on TOC-Bench (2,323 human90
RepProbe Real - OBO19.4OBO (%)66.7
MMVIAD - Object Classification66.2Accuracy (%; MMVIAD-Standard test split, 1,101 rendered 2-se60
TOC-Bench - Conditional State40.6Conditional State accuracy (%) on TOC-Bench (2,323 human-ver60
VideoZeroBench8.6Level-3 accuracy (%), standard end-to-end question answering56.2
EG-VQA - Descriptive10.65Strict accuracy (%) on descriptive questions (directly obser50
EG-VQA - Evidence Grounding11.86Evidence-grounded F1 (%, EG-F1 at temporal IoU 0.3 and seman50
EG-VQA - Temporal8.12Strict accuracy (%) on temporal questions (event order and p50
RepProbe Real - Normalized MAE1.4Normalized MAE (lower is better)50
RepProbe Real - OBO Few25.7OBO Few (%)50
RepProbe Synthetic - Exact5.2Exact (%)50
RepProbe Synthetic - Normalized MAE0.72Normalized MAE (lower is better)50

Interactive version: theaggregate.ai/model?slug=videochat-r1-5-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.