Open LMM Reasoning - MathVerse - Volume: leaderboard

The "MathVerse - Volume" subtask of Open LMM Reasoning. A task from the Open LMM Reasoning leaderboard, which evaluates large multimodal models on multi-step visual, mathematical and logical reasoning problems.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 100 models tracked.

Top models

#ModelScoreOverall rank
1Doubao-1.5-Pro68.6#287
2Gemini 1.5 Pro (002)47.1#349
3Claude 3.7 Sonnet45.1#249
4InternVL3-38B43.1#405
5InternVL3-78B43.1#352
6GPT-4.1 Mini39.2#355
7GPT-4o ChatGPT39.2
8QVQ-72B-Preview39.2#440
9Claude 3.5 Sonnet (20241022)37.3#291
10InternVL3-8B37.3#620
11Gemini 2.0 Flash35.3#342
12GPT-4.1 (2025-04-14)33.3#250
13VLAA-Thinker-Qwen2.5VL-7B33.3#555
14InternVL3-14B31.4#505
15Grok 2 (1212)31.4#496

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-lmm-reasoning-mathverse-volume · How It Works · Data refreshed daily, snapshot 2026-10-20.