Lingshu-7B: benchmark results

lingshu-medical-mllm's Lingshu 7B, a multimodal medical vision-language model supporting over a dozen imaging modalities including X-ray, CT and MRI. Provider: Alibaba. Released 2025-06-05. Access: Open.

Aggregate Rating 1557 ± 13, rank #1599 of 10916 rated models, from 214 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
PathBind - Text-only PTA D546.7Score (%)100
CardioLens56.22F1 (Random) (self-reported)95.7
Medical MM Leaderboard - PathVQA61.9Accuracy (%)95.2
Medical MM Leaderboard - SLAKE83.1Accuracy (%)95.2
Medical MM Leaderboard - OMVQA82.9Accuracy (%)94.7
EviPathBench - Diagnostic Reasoning93.41Accuracy (%) pooled over all questions (the All part of each94.4
PathBind - Image PTA D386.7Score (%)94.1
PathBind - Text-only PTA D144.2Score (%)94.1
Med-R2 - Image Quality67.3Accuracy (%) on the Med-R2 Image Quality task (judging the q92.3
PathBind - Text-only PTA D365Score (%)91.2
MM-NeuroOnco (Closed-Ended)37.6Accuracy (%) on all closed-ended questions; five-option mult88.9
MM-NeuroOnco (Closed-Ended) - Diagnosis39.2Accuracy (%) on tumor-type diagnosis; five-option multiple c88.9

Interactive version: theaggregate.ai/model?slug=lingshu-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.