OODBench (OOD-Hard): leaderboard

Metric: Accuracy (%) on balanced yes/no existence questions ('Does this image contain / not contain a [class]?', opposite labels, so random choice scores 50) about OOD-Hard (flagged as out-of-distribution by both scoring models, CLIP and BLIP-2) instance-category pairs from COCO, LVIS, nuScenes and Cityscapes; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 7B Instruct68.7#643
2Qwen 2 VL 7B Instruct66.77#816
3GPT-4o65.13#333
4InternVL2-8B59.05#826

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=oodbench-ood-hard · How It Works · Data refreshed daily, snapshot 2026-10-11.