OODBench (In-Distribution, CoT): leaderboard

Metric: Accuracy (%) on balanced yes/no existence questions ('Does this image contain / not contain a [class]?', opposite labels, so random choice scores 50) about in-distribution instance-category pairs from COCO, LVIS, nuScenes and Cityscapes, with a step-by-step chain-of-thought instruction; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 7B Instruct93.29#643
2InternVL2-8B93.18#826
3Qwen 2 VL 7B Instruct90.65#816
4GPT-4o78.13#333

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=oodbench-in-distribution-cot · How It Works · Data refreshed daily, snapshot 2026-10-11.