MedMosaic - Heart Sound MCQ: leaderboard

Metric: Accuracy (%; multiple choice, extracted answer letter against the answer key; 9,729 questions on heart sound recordings from HLS-CMDS and CirCor). Source: arxiv.org. Saturation forecast: Around March 2027. 13 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro61.7
2Gemini 2.5 Flash47.2
3Gemma 3n E4B (IT)42
4Phi-4 Multimodal Instruct41.3
5Qwen2.5-Omni-7B33.8
6GPT-4o Audio3.2

Interactive version: theaggregate.ai/benchmark?slug=medmosaic-heart-sound-mcq · How It Works · Data refreshed daily, snapshot 2026-09-26.