EMMA - CoT: leaderboard

Multimodal models solve math, physics, chemistry and coding problems that need reasoning over the image (items taken from older benchmarks were dropped when text-only models given image captions solved them; 1,796 were written new with domain experts); the score is accuracy on full EMMA (2,788 questions) with chain-of-thought prompting, run by the maintainers, as the maintainers' leaderboard prints it (the paper's rows plus one later run whose released result file matches the printed score). Unlike MathVista or MMMU, it filters out items a caption makes solvable. One response per question, scored by rule; no judge model.

Metric: Accuracy (%). Source: emma-benchmark.github.io. Saturation forecast: Estimated already saturated. 6 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1InternVL3-78B33.72#755
2Gemini 2.0 Flash (Preview)29.12#742
3Qwen 2 VL 72B Instruct27.12#1382
4InternVL2.5-78B27.08#1036
5LLaVA-OneVision-72B23.82#1776
6InternVL2-Llama3-76B23.35#2021

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=emma-cot · How It Works · Data refreshed daily, snapshot 2026-11-17.