VideoLLaMA2.1-7B-AV: benchmark results

Provider: Alibaba. Released 2024-10-22. Access: Open.

Aggregate Rating 1447 ± 36, rank #3901 of 10916 rated models, from 40 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OmniPro - Condition Alert24.1Probe-mode accuracy (%): for each ground-truth trigger the m100
AffectSim (Active Observation)20.89Macro-F1 (%; A-Obs: the view reached by the authors' two-sta78.3
AffectSim (Initial View)18.67Macro-F1 (%; P-Init: the agent's initial camera pose, held f78.3
AffectSim (Monitor View)20.27Macro-F1 (%; P-Mon: a fixed room-level monitoring camera; fi73.9
AffectSim (Reference View)27.65Macro-F1 (%; P-Ref: an informative camera trajectory chosen 73.9
OmniPro - Event Alert21.8Probe-mode accuracy (%): for each ground-truth trigger the m71.4
TraceAV-Bench - Visual Counting38.94Accuracy (%) on the 226 Visual Counting (VC) questions, four64.3
OmniCompass-AV - Spatial Grounding - Consistency Score8.6Consistency score (%)43.8
OmniCompass-AV - Temporal Grounding - Consistency Score0.4Consistency score (%)21.9
EmoBench-M48.7Average Score20
OmniPro12.3Probe-mode accuracy (%): for each ground-truth trigger the m14.3
OmniPro - Cumulative Counting4.1Probe-mode accuracy (%): for each ground-truth trigger the m14.3

Interactive version: theaggregate.ai/model?slug=videollama2-1-7b-av · How It Works · Data refreshed daily, snapshot 2026-11-08.