Open LMM Reasoning - WeMath - InadequateGeneralization (Loose): leaderboard

Metric: Accuracy (%). Source: huggingface.co. 83 models tracked.

Top models

#ModelScore
1InternVL3-8B16.2
2Gemma 3 4B15.6
3Taichu-VLR-3B15.4
4Claude 3.5 Sonnet (20241022)15.2
5Gemma 3 27B15.1
6Gemma 3 12B14.7
7VLAA-Thinker-Qwen2.5VL-7B14.5
8Qwen 2 VL 72B13.7
9VLAA-Thinker-Qwen2.5VL-3B13.5
10Qwen 2 VL 7B13.3
11VLM-R1-3B-Math-030513.1
12Gemini 1.5 Pro (002)12.9
13InternVL2.5-78B12.9
14Gemini 2.0 Flash12.9
15GPT-4.1 Nano12.8

Interactive version: theaggregate.ai/benchmark?slug=open-lmm-reasoning-wemath-inadequategeneralization-loose · How It Works · Data refreshed daily, snapshot 2026-09-05.