ST-Bench (Image Input) - Etiological Spatial Reasoning: leaderboard

Etiological spatial reasoning task of ST-Bench (Ni, Wang, He, Jin and Jin, STReasoner paper, 2026): given the multivariate time series of a node graph, the model picks which of four scenario descriptions explains the observed dynamics. The model sees the node series rendered as plot images with the graph structure in text; scenarios are synthetic network simulations and Claude-4.5-Sonnet wrote the questions. Accuracy in percent on 207 held-out questions; higher is better.

Metric: Accuracy (%; 207 four-option questions). Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.286.47#172
2Claude Sonnet 4.579.61#244
3Qwen 3 VL 8B Instruct68.6#982

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=st-bench-image-input-etiological-spatial-reasoning · How It Works · Data refreshed daily, snapshot 2026-11-12.