GeoHeight-Bench+ - Instance Extraction: leaderboard

Metric: Text accuracy (%) on the Instance Extraction task (the model gives an instance of a named category and its height), on GeoHeight-Bench+ (absolute terrain elevation and slope from DEM and DTM products; GeoNRW tiles); zero-shot on RGB imagery only; Qwen2.5-1.5B extracts template answers, which count when continuous values fall within 20 percent relative error, and Qwen2.5-7B judges open-ended answers for semantic and factual consistency; higher is better. Source: arxiv.org. Saturation forecast: Around 2032. 13 models tracked.

Top models

#ModelScoreOverall rank
1InternVL2-8B6.71#826
2GPT-4o6.01#333
3Gemini 2.5 Flash5.71#237
4Pixtral-12B5.34#795

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=geoheight-bench-plus-instance-extraction · How It Works · Data refreshed daily, snapshot 2026-10-11.