AstroReason-Bench - Revisit Optimization - Mapping Coverage: leaderboard
AstroReason-Bench (Wang et al., Fudan University, 2026) has LLM agents plan satellite operations in a physics-grounded simulator (orbit propagation, slewing, power and onboard storage) through tools and a Python API, all in the same Claude Code agent loop, over a four-day horizon. In the revisit task a constellation must keep observing monitoring targets while filling observation quotas for mapping targets; this board scores the mapping side as the percentage of quotas fulfilled, averaged over five generated cases. Higher is better.
Metric: Mapping-quota coverage (%; one run of five procedurally generated cases, Claude Code ReAct harness). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 100 | #244 |
| 2 | Gemini 3 Flash | 86 | #159 |
| 3 | DeepSeek V3.2 | 64 | #403 |
| 4 | DeepSeek V3.1 NEX N1 | 61 | #858 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=astroreason-bench-revisit-optimization-mapping-coverage · How It Works · Data refreshed daily, snapshot 2026-11-12.