MiniCPM-Llama3-V2.5: benchmark results

A vision-language model combining SigLIP-400M with Llama 3 8B Instruct. Its multimodal checkpoint is distinct from the language-only Llama release. Provider: OpenBMB. Released 2024-05-20. Access: Open.

Aggregate Rating 1416 ± 21, rank #5334 of 10916 rated models, from 463 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenVLM MMT-Bench - Industrial Produce Anomaly Detection90Score (%)98.3
OpenVLM MMT-Bench - Multiple Image Captioning100Score (%)97.6
OpenVLM MMT-Bench - Order Hallucination60Score (%)96.6
OpenVLM MMT-Bench - Geometrical Relativity75Score (%)96.1
OpenVLM MMT-Bench - MIA80Score (%)95.6
OpenVLM MMT-Bench - Anatomy Identification80Score (%)95.1
OpenVLM MMT-Bench - Social Relation Recognition70Score (%)94.4
OpenVLM LLaVA-Bench - Conv96.6Score93.8
OpenVLM MMT-Bench - Count57.2Score (%)93
OpenVLM MMT-Bench - Tech Engineering50Score (%)93
OpenVLM MMT-Bench - Spot The Diff85Score (%)92.7
OpenVLM MMT-Bench - Counting By Reasoning90Score (%)92.2

Interactive version: theaggregate.ai/model?slug=minicpm-llama3-v2-5 · How It Works · Data refreshed daily, snapshot 2026-11-08.