GeoMMBench - DEM: leaderboard

The digital elevation model questions of GeoMMBench (2026), an expert-written multimodal geoscience and remote sensing question benchmark answered zero-shot (test set). Micro-averaged accuracy in percent; higher is better.

Metric: Micro-averaged accuracy (%) on the digital elevation model questions of the GeoMMBench test set (expert-written multimodal geoscience and remote sensing multiple-choice and numeric questions, zero-shot, LMMs-Eval, rule-based answer extraction, invalid outputs counted wrong); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 35 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 2.0 Flash67.1#723
2Gemini 1.5 Pro64.7#1063
3O163.5#403
4GPT-4o62.3#751
5GPT-4V61.7#1470
6Qwen 3 VL 30B59.9#561
7Qwen 3 VL 8B59.3#917
8Qwen 2.5 VL 7B52.1#1862
9Qwen 2 VL 7B51.5#2275
10Phi-4 Multimodal Instruct50.3#4154
11LLaVA-OneVision-7B50.3#2981
12Qwen 3 VL 4B49.7#1151
13Qwen 2.5 VL 3B48.5#2639
14CogVLM248.5
15NVILA-15B47.3#1929

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=geommbench-dem · How It Works · Data refreshed daily, snapshot 2026-11-21.