Molmo-72B: benchmark results

Provider: Allen AI. Released 2024-09-24. Access: Open.

Aggregate Rating 1438 ± 38, rank #4256 of 10916 rated models, from 196 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
GQA86.67Overall Accuracy (%)98.8
OpenVLM MMStar - Fine-Grained Perception62.8Accuracy (%)96.8
OpenVLM MMMU - Clinical Medicine73.3Accuracy (%)94.5
OpenVLM AI2D - Eclipses96.8Accuracy (%)93.1
OpenVLM AI2D - Volcano100Accuracy (%)92.8
OpenVLM RealWorldQA73.7Accuracy (%)92.7
OpenVLM MMBench V1.1 CN - Physical Relation68Accuracy (%)90.1
OpenVLM MMStar - Coarse Perception72.4Accuracy (%)89.9
OpenVLM MMBench V1.1 CN - Spatial Relationship73.3Accuracy (%)86.2
OpenVLM MME - Count171.7Score84.8
OpenVLM MME - Posters182.3Score84.6
OpenVLM MMMU - Management66.7Accuracy (%)84.5

Interactive version: theaggregate.ai/model?slug=molmo-72b · How It Works · Data refreshed daily, snapshot 2026-11-08.