Chameleon-7B: benchmark results

Provider: Meta. Released 2024-06-16. Access: Open.

Aggregate Rating 1189 ± 48, rank #9458 of 10489 rated models, from 420 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenVLM MMT-Bench - Pixel Localization40Score (%)84.5
OpenVLM MMT-Bench - Raven Progressive Matrices20Score (%)76.2
OpenVLM MMT-Bench - Table Structure Recognition75Score (%)74.5
OpenVLM COCO Captions2.1CIDEr68.3
OpenVLM MMT-Bench - Sketch-to-Code30Score (%)66.5
OpenVLM MMT-Bench - Animal Keypoint Detection35Score (%)65.3
OpenVLM MathVista - LOG21.6Accuracy (%)58.2
OpenVLM MMT-Bench - Rotated Object Detection33.3Score (%)55.1
OpenVLM MMT-Bench - Spot The Diff25Score (%)51.7
Med-RewardBench56.15Expert-Agreement Accuracy (%; pairwise, six dimensions)51.5
OpenVLM MMT-Bench - Image Quality Assessment35Score (%)45.4
OpenVLM MMT-Bench - 3D Indoor Recognition25Score (%)39.3

Interactive version: theaggregate.ai/model?slug=chameleon-7b · How It Works · Data refreshed daily, snapshot 2026-11-20.