TerraLogic - Spatial Statistics Toolkit: leaderboard

Part of TerraLogic (CUHK-Shenzhen and TUM, 2026): 545 scenario-driven geospatial reasoning tasks over optical, SAR and infrared imagery solved through verifiable tool chains, each model driving the HieraPlan reference agent. The score is the end-to-end score of tool-augmented predictions in the spatial-statistics toolkit in percent; higher is better.

Metric: End-to-end score (%) of tool-augmented predictions on the Spatial Statistics toolkit over the 545 TerraLogic remote-sensing tasks, each model driving the HieraPlan tool agent under a ReAct-style protocol in OpenCompass; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o88.38#741
2Qwen 2.5 7B Instruct73.03#2564
3Llama 3 70B Instruct71.62#1676
4Qwen 2.5 32B Instruct67.4#1215
5DeepSeek V366.04#716
6GPT-3.561.04#2417
7InternLM3-8B-Instruct53.7#2568
8Mistral 7B Instruct (v0.2)44.05#7007
9Gemini 2.5 Flash40.89#453
10Yi-1.5-6B-Chat38.73#6399
11Phi-3 Mini 4K Instruct7.52#6810

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=terralogic-spatial-statistics-toolkit · How It Works · Data refreshed daily, snapshot 2026-11-13.