DRBench (Dense-Scene Reasoning) - False Premise Rejection: leaderboard
The false premise rejection category of DRBench: questions about a plausible but absent object, where the correct answer rejects the premise. DRBench (Shi et al., Shanghai Jiao Tong University, 2026, introduced with DRScaffold) asks questions about cluttered indoor (Hypersim) and urban driving (Cityscapes) scenes that require grounding several objects and their relations. Combined accuracy in percent over 156 test questions: multiple-choice answers by exact letter match and open answers by a Qwen-Max semantic judge, weighted by question count; higher is better.
Metric: Combined accuracy (%; rejecting a query that presupposes a plausible but absent object; 156 test questions). Source: arxiv.org. Saturation forecast: Around February 2027. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | InternVL2.5-2B | 30.1 | #6868 |
| 2 | Phi-4 Multimodal Instruct | 23.1 | #3914 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=drbench-dense-scene-reasoning-false-premise-rejection · How It Works · Data refreshed daily, snapshot 2026-11-12.