Qwen 2.5 VL 7B Instruct: benchmark results

Alibaba Qwen 2.5 VL 7B vision-language instruction-tuned checkpoint. Provider: Alibaba. Released 2025-01-26. Access: Open.

Aggregate Rating 1537 ± 3, rank #654 of 1656 rated models, from 1374 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AgentRx (Multimodal, Zero-Shot) - Length of Stay0.71AUROC (0-1; stay beyond seven days; MIMIC-IV ICU test split;100
BanglaMedVQA (English)48.25Exact-match accuracy (%; mean of the Chest X-Ray and MedICaT100
BanglaMedVQA (English) - Chest X-Ray46.5Exact-match accuracy (%; 1,000 questions on ChestX-ray14 rad100
BanglaMedVQA (English) - MedICaT50Exact-match accuracy (%; 1,000 questions on MedICaT figures;100
BanglaMedVQA (English, CoT)47Exact-match accuracy (%; mean of the Chest X-Ray and MedICaT100
BanglaMedVQA (English, CoT) - Chest X-Ray48Exact-match accuracy (%; 1,000 questions on ChestX-ray14 rad100
CogRail RailThreat (Cog-MRSI, Type-II Visual Prompt)42.81Overall F1 (%; harmonic mean of macro precision and macro re100
CourtSI-Bench - Player-Zone58.5Exact-match accuracy (%) on the 82 player-to-court-zone rela100
DatBench - Scene OCR82.6Accuracy (%)100
ECAC45.25Teaching Toy Recognition Score (TTS, %): share of the teachi100
ECAC - Caption Quality85.7Overall caption quality score (0-100) from a moonshot-v1-8k-100
FGTR-Bench - Daytime Signal97.9Accuracy (%) on 750 daytime traffic-signal questions, 4-opti100

Interactive version: theaggregate.ai/model?slug=qwen-2-5-vl-7b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.