LoMeVQA - Progress Description: leaderboard

Metric: F1-RadGraph clinical efficacy (%; free-text description of the change between two radiographs, clinical entities and relations matched against the reference; LoMeVQA-test, 2,500 expert-reviewed longitudinal chest radiograph samples over five tasks, zero-shot; higher is better). Source: arxiv.org. Saturation forecast: Around 2038. 16 models tracked.

Top models

#ModelScore
1Lingshu-32B26.67
2Gemini 2.5 Flash23.55
3MedGemma-4B20.95
4Lingshu-7B19.78
5InternVL3.5-8B19.4
6GPT-518.3
7GPT-4o14.36
8MedGemma-27B-IT12.93
9Qwen 3 VL 32B8.41

Interactive version: theaggregate.ai/benchmark?slug=lomevqa-progress-description · How It Works · Data refreshed daily, snapshot 2026-09-29.