FindIt - Single-Label Object Detection: leaderboard

Metric: Average F1@0.5 (%) over single-label object detection (all instances of one named category) on 1,000-query subsets of Pascal VOC, OpenImages and iGround; each model scored with the box representation, text or JSON output and JSON key that a two-stage probe on Pascal VOC found best for it; boxes Hungarian-matched to the ground truth, a match counts at IoU 0.5 or more (with the right label for multi-label queries); unparseable outputs count as empty; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 10 models tracked.

Top models

#ModelScore
1Qwen 3 VL 8B Instruct66.9
2Qwen 3.5 9B (Thinking)63.2
3Qwen 3.5 9B (Non-reasoning)62.2
4Gemini 2.5 Flash (Non-reasoning)58.2
5InternVL3-8B55
6Gemma 4 E4B52.4
7GPT-5.4 (Non-reasoning)42.5
8Qwen 2.5 VL 7B Instruct34.2
9Claude Sonnet 4.524.5

Interactive version: theaggregate.ai/benchmark?slug=findit-single-label-object-detection · How It Works · Data refreshed daily, snapshot 2026-09-29.