VMMU: leaderboard

Vietnamese multimodal exam benchmark: 2,548 multiple-choice questions from the national high-school graduation exam (math, physics, chemistry, biology, geography), the driving-licence test and IQ tests, each shown to a vision-language model as one rendered page image. Scored by mean accuracy over the seven domains, higher is better (Dang et al., AACL-IJCNLP 2026 Findings).

Metric: Mean accuracy (%) over the seven domains of 2,548 Vietnamese multiple-choice exam questions, each given as one rendered page image with the question, options and visual evidence (answer letter extracted from curly brackets; random baseline 25.9); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro86.33#137
2GPT-5 (Medium)78.41#167 (GPT-5)
3Claude Opus 4.6 (Thinking)74.62#102 (Claude Opus 4.6)
4O3 (Medium)73.98#228 (O3)
5Gemini 2.5 Flash71.34#453
6Qwen 2.5 VL 32B Instruct52.13#1053
7Qwen 2.5 VL 72B Instruct51.75#846
8GPT-4.151.58#495
9Claude Sonnet 450.58#400
10Llama 4 Scout49.06#1776
11Gemma 3 27B39.09#1631
12Llama 4 Maverick38.37#1099
13Mistral Medium 337.78#1073
14Mistral Small 3.231.88#1591
15Gemma 3 4B25.45#5064

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=vmmu · How It Works · Data refreshed daily, snapshot 2026-11-13.