VISTA (Video Grounding) - Human-Object: leaderboard

Metric: Mean spatio-temporal IoU (m_vIoU, %): per-frame box IoU summed over the frames where predicted and true tubes overlap in time, divided by their temporal union, on human-object interactions, over the 11,814 video-query pairs of VISTA (HCSTVG-v1 and v2, VidVRD, VidSTG, MeViS and RVOS videos re-annotated with an interaction taxonomy), zero-shot on sub-sampled frames; the model must localize the queried subject with a box in every frame; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 10 models tracked.

Top models

#ModelScore
1Qwen3-VL-8B64.7
2VISTA CogVLM Grounding (checkpoint unspecified)54
3InternVL2.5-8B49.5
4Qwen-VL-Chat47.9
5VISTA Sphinx-v2 (checkpoint unspecified)46.8
6MiniGPT-v246.1
7LLaVA-Grounding-7B37
8VISTA MiMo-VL-7B (checkpoint unspecified)36.1
9Shikra-7B35.3
10Ferret-7B24.5

Interactive version: theaggregate.ai/benchmark?slug=vista-video-grounding-human-object · How It Works · Data refreshed daily, snapshot 2026-10-07.