RS-Neg VQA: leaderboard

Yes/no questions that negate a present or an absent scene element. RS-Neg (Han et al., Peng Cheng Laboratory, 2026) tests negation understanding on remote-sensing images, with negated queries written by LLMs from image captions and checked against the image by a detector-guided visual search. Accuracy in percent over 9,205 questions, answered zero-shot; higher is better.

Metric: Accuracy (%; yes/no questions that negate a present or an absent scene element; 9,205 questions; zero-shot). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 7B Instruct74.96#1842
2Qwen 3 VL 8B Instruct71.47#982

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=rs-neg-vqa · How It Works · Data refreshed daily, snapshot 2026-11-12.