FindIt - Video Detection: leaderboard

Metric: Average F1@0.5 (%) over video detection (localize the target in every sampled frame) on RoboTools instance detection and iGround object detection clips at 2 and 8 uniformly sampled frames; each model scored with the box representation, text or JSON output and JSON key that a two-stage probe on Pascal VOC found best for it; boxes Hungarian-matched to the ground truth, a match counts at IoU 0.5 or more (with the right label for multi-label queries); unparseable outputs count as empty; higher is better. Source: arxiv.org. Saturation forecast: Around 2034. 10 models tracked.

Top models

#ModelScore
1GPT-5.4 (Non-reasoning)31.4
2Qwen 3.5 9B (Thinking)30.2
3Gemini 2.5 Flash (Non-reasoning)28.9
4Qwen 3 VL 8B Instruct25.8
5InternVL3-8B17.9
6Gemma 4 E4B17.2
7Claude Sonnet 4.511.8

Interactive version: theaggregate.ai/benchmark?slug=findit-video-detection · How It Works · Data refreshed daily, snapshot 2026-09-29.