VISTA (Video Grounding) - Human-Animal: leaderboard

VISTA (2026) spatio-temporal video grounding on queries describing interactions between a person and an animal. Mean spatio-temporal IoU in percent; higher is better.

Metric: Mean spatio-temporal IoU (m_vIoU, %): per-frame box IoU summed over the frames where predicted and true tubes overlap in time, divided by their temporal union, on human-animal interactions, over the 11,814 video-query pairs of VISTA (HCSTVG-v1 and v2, VidVRD, VidSTG, MeViS and RVOS videos re-annotated with an interaction taxonomy), zero-shot on sub-sampled frames; the model must localize the queried subject with a box in every frame; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 8B74.5#917
2VISTA CogVLM Grounding (checkpoint unspecified)70.2
3Qwen-VL-Chat65.2#7860
4LLaVA-Grounding-7B56.1
5InternVL2.5-8B52.2#2370
6VISTA Sphinx-v2 (checkpoint unspecified)51
7MiniGPT-v248.5
8VISTA MiMo-VL-7B (checkpoint unspecified)38.3
9Shikra-7B36
10Ferret-7B23.3

Interactive version: theaggregate.ai/benchmark?slug=vista-video-grounding-human-animal · How It Works · Data refreshed daily, snapshot 2026-11-21.