OpenVLM Video - TempCompass - Speed: leaderboard

TempCompass Speed accuracy from the OpenCompass OpenVLM Video Leaderboard (VLMEvalKit): questions on how fast things move in videos where a single frame cannot answer, pooled over the multi-choice, yes-or-no, caption-matching and captioning formats. Percent, higher is better; runs with a failed format (exactly 0) are left out.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 34 models tracked.

Top models

#ModelScoreOverall rank
1InternVL3-38B66.73#413
2InternVL3-78B65.04#361
3Qwen 2 VL 72B64.06#450
4InternVL3-8B56.56#624
5Claude 3.5 Sonnet56.16#362
6Qwen2.5-Omni-7B55.84#633
7Qwen 2.5 VL 7B55.12#641
8Gemini 1.5 Flash54.53#620
9InternVL2-8B52.84#813
10Gemini 2.0 Flash52.51#351
11Qwen 2 VL 7B51.86#743
12MiniCPM-V-2.650.95#827
13Phi-4 Multimodal Instruct45.79#922

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openvlm-video-tempcompass-speed · How It Works · Data refreshed daily, snapshot 2026-11-05.