SADL - Open Detection: leaderboard

Metric: Open detection F1 (%, times 100): the model lists distractors from the image and subject description alone, the labels are grounded to masks by SAM 3 and matched to annotated distractors at IoU 0.5, over the 14,617 annotated candidates of SADL (1,800 subject-aware cases on 1,000 photographs, including 1,938 hard negatives), zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 7 models tracked.

Top models

#ModelScore
1Gemini 3 Pro40.6
2Qwen 3 VL 235B A22B36.2
3GPT-4.132.5
4Pixtral-12B29.8
5GPT-4o27.6
6Molmo2-8B27.5
7Llama 4 Scout26.5

Interactive version: theaggregate.ai/benchmark?slug=sadl-open-detection · How It Works · Data refreshed daily, snapshot 2026-09-29.