TerraLogic - Perception Toolkit: leaderboard

Part of TerraLogic (CUHK-Shenzhen and TUM, 2026): 545 scenario-driven geospatial reasoning tasks over optical, SAR and infrared imagery solved through verifiable tool chains, each model driving the HieraPlan reference agent. The score is the end-to-end score of tool-augmented predictions in the perception toolkit (segmentation and detection) in percent; higher is better.

Metric: End-to-end score (%) of tool-augmented predictions on the Perception toolkit over the 545 TerraLogic remote-sensing tasks, each model driving the HieraPlan tool agent under a ReAct-style protocol in OpenCompass; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o72.73#741
2Qwen 2.5 7B Instruct68.56#2564
3DeepSeek V365.44#716
4Llama 3 70B Instruct62.72#1676
5InternLM3-8B-Instruct61.44#2568
6GPT-3.561.22#2417
7Mistral 7B Instruct (v0.2)49.75#7007
8Yi-1.5-6B-Chat47.44#6399
9Qwen 2.5 32B Instruct44.28#1215
10Phi-3 Mini 4K Instruct43.63#6810
11Gemini 2.5 Flash41.47#453

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=terralogic-perception-toolkit · How It Works · Data refreshed daily, snapshot 2026-11-13.