SDGBiasBench - MCQ (Reduced Variable Names): leaderboard

Three-option ordinal questions about Sustainable Development Goal indicators of a place from satellite and street-level imagery, with only the names of a reduced set of variables given as hints; SDGBiasBench (Lin et al., 2026). Accuracy in percent; higher is better.

Metric: Accuracy (%; three-option ordinal questions on SDG indicators from satellite and street-level imagery, only the names of a reduced subset of variables given as hints). Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 VL 7B53#1796
2InternVL3-8B51#1695
3GPT-4o49#741
4Gemini 2.0 Flash45#702
5Claude 3.5 Sonnet43#747
6InternVL3-14B40#1184

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=sdgbiasbench-mcq-reduced-variable-names · How It Works · Data refreshed daily, snapshot 2026-11-12.