VidMsg QA (YouTube Input): leaderboard
Metric: Overall accuracy (%), five-option multiple choice: pick the intended implicit message of a short YouTube clip from distractors sampled within the same topic (one question per clip over 9 topics and 52 target messages; the per-topic cells imply 395 scored clips); chance 20; the model receives the clip through native YouTube URL access (video with audio) instead of sampled frames; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 2 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 76.5 |
| 2 | Gemini 3 Flash | 76.5 |
Interactive version: theaggregate.ai/benchmark?slug=vidmsg-qa-youtube-input · How It Works · Data refreshed daily, snapshot 2026-09-29.