OpenVLM MTVQA - Japanese: leaderboard

MTVQA Japanese accuracy from the OpenCompass OpenVLM Leaderboard (VLMEvalKit): questions about Japanese text in scene and document images, asked and answered in Japanese. One of the nine language splits of the multilingual text-centric VQA benchmark; accuracy in percent, higher is better.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 157 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4.1 Mini24#363
2InternVL3-8B22.3#624
3InternVL3-78B22.3#361
4GPT-4.1 (2025-04-14)22.2#257
5InternVL3-38B21.5#413
6InternVL3-14B21.5#506
7Claude 3.7 Sonnet21.5#259
8Qwen 2 VL 72B19.8#450
9Gemini 1.5 Pro18.8#454
10Qwen 2.5 VL 7B18.5#641
11Gemma 3 27B17.6#606
12Gemini 1.5 Flash17.1#620
13GPT-4.1 Nano17#730
14Qwen 2 VL 7B16.8#743
15Moonshot v1 8K15.1#622

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=openvlm-mtvqa-japanese · How It Works · Data refreshed daily, snapshot 2026-11-05.