Qwen 2.5 VL 32B Instruct: benchmark results

Alibaba Qwen 2.5 VL 32B vision-language instruction-tuned checkpoint. Provider: Alibaba. Released 2025-03-24. Access: Open.

Aggregate Rating 1597 ± 5, rank #453 of 1656 rated models, from 584 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
DefectBench (Building Facades) - Surface Stain Counting Error0.94Mean absolute error of the model's count of surface-stain in100
EVALITA - MAIA-MC87.26CPS100
EVALITA - word-in-context77.56CPS100
LLM Stats (InfoVQA)83.4Score (%)100
MMBU - Grounded Classification (Masks)69.3Closed-ended classification of a region marked by a segmenta100
OrdinalBench (2D Single-Loop)32.83Final accuracy (%) of naming the N-th object when counting f100
RebusBench (1-Shot)7.39Exact match: exact match accuracy (%) against the gold answe100
RebusBench (3-Shot)8.08Exact match: exact match accuracy (%) against the gold answe100
SAW-Bench - Self-Localization53Accuracy (%) on the 200 self-localization questions (where t100
UVLM Street-View Benchmark (Reasoning)88Mean proximity score (%) in advanced-reasoning mode (chain o100
UVLM Street-View Benchmark (Standard)83.3Mean proximity score (%) in standard mode (direct numeric an100
Open Portuguese LLM - BLUEX80.53Accuracy (%)98.7

Interactive version: theaggregate.ai/model?slug=qwen-2-5-vl-32b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.