Molmo-7B-D-0924: benchmark results

Provider: Allen AI. Access: Open.

Aggregate Rating 1357 ± 28, rank #7537 of 10916 rated models, from 54 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
HyperGVL - Isomorphism Recognition45.9Accuracy (%) on deciding whether two hypergraphs are isomorp36.4
HyperGVL - Order-Weighted Maximum Flow6.74Accuracy (%) on the maximum flow between two vertices with h36.4
HyperGVL - Strict Hypercycle6.8Accuracy (%) on finding a strict hypercycle, adjacent hypere36.4
DocHop16.01Accuracy (%)35
HyperGVL - Understanding18.6Average accuracy (%) over the six understanding tasks (verte30
HyperGVL - Degree-Specified Vertex Counting13.24Accuracy (%) on counting vertices with a given degree, 7,00027.3
HyperGVL - Hyperedge Counting17.94Accuracy (%) on counting the hyperedges of a hypergraph, 7,027.3
HyperGVL - Neighbors7.96Accuracy (%) on listing the direct neighbors of a vertex, 7,27.3
HyperGVL - Order-Filtered Neighbors14.4Accuracy (%) on listing a vertex's neighbors through hypered27.3
HyperGVL - Order-Weighted Shortest Path10.53Accuracy (%) on the shortest path length between two vertice27.3
HyperGVL - Reasoning12.83Average accuracy (%) over the six reasoning tasks (order-wei27.3
ChartJudgeBench - CPA Axis Scaling8.5Pairwise judging accuracy (%; the 141 axis scaling pairs; tw26

Interactive version: theaggregate.ai/model?slug=molmo-7b-d-0924 · How It Works · Data refreshed daily, snapshot 2026-11-08.