SciVQR - Astronomy: leaderboard
The astronomy questions of SciVQR (2026), 3,254 image-based scientific questions from competitions, entrance exams and graduate-level sources in English and Chinese, answered with zero-shot chain-of-thought. Accuracy in percent; higher is better.
Metric: Astronomy accuracy (%) with zero-shot chain-of-thought prompting on SciVQR (3,254 image-based scientific questions from competitions, entrance exams and graduate-level sources, 78 percent multiple-choice and 22 percent free-form, in English and Chinese, high-school to graduate level); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | O1 | 74.5 | #403 | |
| 2 | Gemini 2.5 Flash (Preview 04-17) | 72 | #453 | |
| 3 | O4 Mini | 71 | #368 | |
| 4 | GPT-4o | 66.5 | #751 | |
| 5 | MiMo-VL-7B-RL-2508 | 66 | #823 | |
| 6 | Qwen 2.5 VL 72B Instruct | 62.5 | #841 | |
| 7 | Keye-VL-1.5-8B | Thinking | 61.5 | #1720 |
| 8 | InternVL3-78B-Instruct | 57.5 | #1415 | |
| 9 | InternVL3-14B-Instruct | 55.5 | #1801 | |
| 10 | InternVL3-8B-Instruct | 52.5 | #2872 | |
| 11 | Qwen 2.5 VL 7B Instruct | 48 | #1902 | |
| 12 | LLaVA-OneVision-7B | 37.5 | #2981 | |
| 13 | Molmo-7B-D-0924 | 35 | #7207 | |
| 14 | LLaVA-NeXT-7B | 29 | #5032 | |
| 15 | MiniCPM-o-2.6 | 27 | #2423 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=scivqr-astronomy · How It Works · Data refreshed daily, snapshot 2026-11-21.