Holtercare-Bench - Event Counting (Video): leaderboard

Metric: Accuracy (%; multiple-choice closed QA on how many times a given anomaly occurs; the ECG rendered as a sliding-window video, accelerated or truncated to fit input limits; zero-shot on the held-out test cases of Holtercare-23K, 20 percent of 788 clinical Holter recordings of 13-24 hours). Source: arxiv.org. Saturation forecast: Around 2030. 7 models tracked.

Top models

#ModelScore
1Gemini 3 Flash22.63
2Lingshu-7B20.18
3MiniCPM-V-4.5-8B19.57
4InternVL3.5-8B14.07

Interactive version: theaggregate.ai/benchmark?slug=holtercare-bench-event-counting-video · How It Works · Data refreshed daily, snapshot 2026-09-29.