VideoChat2: benchmark results

Provider: Other.

Aggregate Rating 1484 ± 31, rank #2601 of 10916 rated models, from 49 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SceneBench - Scene QA31.5Accuracy (%) on SceneBench's 3,311 scene qa items (questions88.9
SceneBench - Scene QA (Audio)36.1Accuracy (%) on SceneBench's 4,097 scene qa (audio) items (s88.9
MuseBench - Game Arts (Single-Select)10.45Game-arts chance-adjusted accuracy (%): raw single-select ac63
SceneBench - Title Prediction98.3Accuracy (%) on SceneBench's 345 title prediction items (cho55.6
E3mo-Bench (Evoked) - Open-Vocabulary Recognition (Emotion Wheel)57.17Emotion-wheel set F-score (%; the OV-MER semantic emotion wh53.3
VidPair-Halluc - Open-Ended Description42.25Open-ended description score (%) judged by GPT-4o on VidPair50
E3mo-Bench (Evoked) - Open-Vocabulary Recognition (VAD Similarity)44.66Redundancy-aware VAD set similarity F-VAD (%; predicted and 46.7
SceneBench - Comment Prediction72.5Accuracy (%) on SceneBench's 297 comment prediction items (c44.4
SceneBench52.8Average accuracy (%) over SceneBench's six tasks (title and 38.9
E3mo-Bench (Evoked) - Video-Pair Perception (Yes-or-No)50.42Accuracy (%; yes-or-no questions comparing the emotion, vale33.3
V-STaR18.64Average All Score30.8
V-STaR - All mAM17.02Score30.8

Interactive version: theaggregate.ai/model?slug=videochat2 · How It Works · Data refreshed daily, snapshot 2026-11-08.