Molmo 7B-O: benchmark results

Provider: Allen AI. Released 2024-09-25. Access: Open.

Aggregate Rating 1376 ± 29, rank #6961 of 10916 rated models, from 441 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenVLM SEEDBench IMG - Text Understanding83.3Accuracy (%)98.9
OpenVLM MMT-Bench - Image Season Recognition90Score (%)98.3
OpenVLM MMT-Bench - GUI General65Score (%)96.6
OpenVLM MMT-Bench - Color Contrast80Score (%)95.9
OpenVLM MMT-Bench - Counting By Category43.8Score (%)95.9
OpenVLM MMT-Bench - Temporal Localization63.2Score (%)93.7
OpenVLM MMT-Bench - Image Quality Assessment65Score (%)93.4
OpenVLM MMT-Bench - VI65.9Score (%)93.4
OpenVLM MMT-Bench - Color Assimilation75Score (%)93
OpenVLM MMT-Bench - Count57.2Score (%)93
OpenVLM MMT-Bench - Age, Gender, and Race Recognition90Score (%)91.3
OpenVLM MMT-Bench - Face Mask Anomaly Detection65Score (%)90.8

Interactive version: theaggregate.ai/model?slug=molmo-7b-o · How It Works · Data refreshed daily, snapshot 2026-11-08.