CardioLens: leaderboard

Multimodal Large Language Models (MLLMs) have shown strong performance on public medical benchmarks, yet existing evaluations often remain weak proxies for clinical use, relying on isolated inputs and simplified recognition-style tasks. We introduce CardioLens, a leakage-resistant evaluation testbed for multi-sequence Cardiovascular Magnetic Resonance (CMR), constructed from private hospital archi

Metric: F1 (Random) (self-reported). Source: benchmarklist.com. 24 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 3 27B51.77#607
2Gemma 4 31B51.61#200
3MedGemma-4B51.53#746
4GPT-549.21#98
5Claude Opus 4.645.55#63
6Gemini 3.1 Pro (Preview)44.41#58
7Llama 3.2 11B41.01#1199
8phi-4-14B36.4#733

Interactive version: theaggregate.ai/benchmark?slug=cardiolens · How It Works · Data refreshed daily, snapshot 2026-10-20.