GeoHeight-Bench+ - Pixel Information: leaderboard

Metric: Text accuracy (%) on the Pixel Information task (the model gives the land-cover category, height and spatial scale at a given location), on GeoHeight-Bench+ (absolute terrain elevation and slope from DEM and DTM products; GeoNRW tiles); zero-shot on RGB imagery only; Qwen2.5-1.5B extracts template answers, which count when continuous values fall within 20 percent relative error, and Qwen2.5-7B judges open-ended answers for semantic and factual consistency; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 13 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash5.41#237
2Pixtral-12B2.96#795
3InternVL2-8B1.8#826
4GPT-4o0.68#333

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=geoheight-bench-plus-pixel-information · How It Works · Data refreshed daily, snapshot 2026-10-11.