SciVQR - Astronomy: leaderboard
Metric: Astronomy accuracy (%) with zero-shot chain-of-thought prompting on SciVQR (3,254 image-based scientific questions from competitions, entrance exams and graduate-level sources, 78 percent multiple-choice and 22 percent free-form, in English and Chinese, high-school to graduate level); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O1 | 74.5 |
| 2 | Gemini 2.5 Flash (Preview 04-17) | 72 |
| 3 | O4 Mini | 71 |
| 4 | GPT-4o | 66.5 |
| 5 | Qwen 2.5 VL 72B Instruct | 62.5 |
| 6 | Qwen 2.5 VL 7B Instruct | 48 |
Interactive version: theaggregate.ai/benchmark?slug=scivqr-astronomy · How It Works · Data refreshed daily, snapshot 2026-10-07.