Open LMM Reasoning - WeMath - Basic Transformations of Figures: leaderboard

The "WeMath - Basic Transformations of Figures" subtask of Open LMM Reasoning. A task from the Open LMM Reasoning leaderboard, which evaluates large multimodal models on multi-step visual, mathematical and logical reasoning problems.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 83 models tracked.

Top models

#ModelScoreOverall rank
1Doubao-1.5-Pro76.2#287
2GPT-4.1 (2025-04-14)75.8#250
3Gemini 2.0 Flash71.7#342
4GPT-4o ChatGPT70.6
5Claude 3.7 Sonnet66.5#249
6Claude 3.5 Sonnet (20241022)66.2#291
7Gemini 1.5 Pro (002)65.9#349
8Taichu-VLR-7B64.3#526
9Qwen 2 VL 72B64#460
10InternVL3-38B62.6#405
11InternVL2.5-78B62.1#431
12InternVL2.5-8B-BoN-861.5#639
13InternVL3-8B61.3#620
14InternVL3-14B59.9#505
15Gemma 3 27B59.9#607

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=open-lmm-reasoning-wemath-basic-transformations-of-figures · How It Works · Data refreshed daily, snapshot 2026-10-20.