EO-Gym: leaderboard

Earth Observation (EO) analysis is inherently interactive: resolving uncertainty often requires expanding the region of interest, retrieving historical observations, and switching across sensors such as optical and Synthetic Aperture Radar. However, most EO benchmarks collapse this process into fixed-input, single-turn tasks. To address this gap, we present EO-Gym, a controlled executable framewor

Metric: Pass@3 (self-reported). Source: benchmarklist.com. Saturation forecast: Around February 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro67#152
2GPT-4.1 Mini64#355
3GPT-4.164#248
4Gemini 2.5 Flash63#245
5GPT-5.163#135
6Qwen 3 VL 32B Instruct59#283
7Qwen 3 VL 8B (Thinking)52
8Qwen 3 VL 8B Instruct49#420
9Qwen 3 VL 4B Instruct49#515
10Qwen 3 VL 4B (Thinking)49#480 (Qwen 3 VL 4B)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=eo-gym · How It Works · Data refreshed daily, snapshot 2026-10-20.