SciVQR - Chemistry: leaderboard

The chemistry questions of SciVQR (2026), 3,254 image-based scientific questions from competitions, entrance exams and graduate-level sources in English and Chinese, answered with zero-shot chain-of-thought. Accuracy in percent; higher is better.

Metric: Chemistry accuracy (%) with zero-shot chain-of-thought prompting on SciVQR (3,254 image-based scientific questions from competitions, entrance exams and graduate-level sources, 78 percent multiple-choice and 22 percent free-form, in English and Chinese, high-school to graduate level); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 2.5 Flash (Preview 04-17)87.6#457
2O4 Mini85.4#372
3O179.5#407
4MiMo-VL-7B-RL-250874.7#829
5Qwen 2.5 VL 72B Instruct66.6#849
6GPT-4o60.1#754
7Keye-VL-1.5-8BThinking53.9#1729
8InternVL3-78B-Instruct52#1436
9InternVL3-14B-Instruct49.6#1810
10Qwen 2.5 VL 7B Instruct43.2#1919
11InternVL3-8B-Instruct38.4#2906
12LLaVA-OneVision-7B24.6#3002
13Molmo-7B-D-092423.4#7206
14MiniCPM-o-2.622.7#2442
15LLaVA-NeXT-7B14.1#5045

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=scivqr-chemistry · How It Works · Data refreshed daily, snapshot 2026-11-22.