Holtercare-Bench - Event Counting (Text): leaderboard
Metric: Accuracy (%; multiple-choice closed QA on how many times a given anomaly occurs; the ECG lead given as text, values in millivolts to three decimals, truncated where it exceeds the input limit; zero-shot on the held-out test cases of Holtercare-23K, 20 percent of 788 clinical Holter recordings of 13-24 hours). Source: arxiv.org. Saturation forecast: Around 2035. 13 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | MiniCPM-V-4.5-8B | 51.38 |
| 2 | Lingshu-7B | 35.17 |
| 3 | GPT-5 Mini | 31.8 |
| 4 | InternVL3.5-8B | 29.66 |
| 5 | Phi-4 Mini Instruct | 27.83 |
| 6 | Claude Haiku 4.5 | 25.99 |
| 7 | MedGemma 1.5 4B | 20.8 |
| 8 | Gemini 3 Flash | 14.98 |
Interactive version: theaggregate.ai/benchmark?slug=holtercare-bench-event-counting-text · How It Works · Data refreshed daily, snapshot 2026-09-29.