Holtercare-Bench - Presence (Text): leaderboard

Holtercare-Bench (2026) asks multimodal models closed multiple-choice questions about long-term dynamic ECG (Holter) recordings of 13 to 24 hours from real hospital cases. The presence task asks for whether a given rhythm or abnormal waveform occurs in the recording; the ECG lead is given as text values in millivolts. Score is accuracy in percent; higher is better.

Metric: Accuracy (%; multiple-choice closed QA on whether a given rhythm or abnormal waveform occurs in the recording; the ECG lead given as text, values in millivolts to three decimals, truncated where it exceeds the input limit; zero-shot on the held-out test cases of Holtercare-23K, 20 percent of 788 clinical Holter recordings of 13-24 hours). Source: arxiv.org. Saturation forecast: Around May 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5 Mini76.31#348
2Gemini 3 Flash67.32#164
3MedGemma 1.5 4B62.42#2562
4Phi-4 Mini Instruct52.78#6419
5Claude Haiku 4.551.63#568

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=holtercare-bench-presence-text · How It Works · Data refreshed daily, snapshot 2026-11-13.