Holtercare-Bench - Event Timing (Video): leaderboard

Metric: Accuracy (%; multiple-choice closed QA on the millisecond timestamps of every occurrence of an abnormal event, among close distractors; the ECG rendered as a sliding-window video, accelerated or truncated to fit input limits; zero-shot on the held-out test cases of Holtercare-23K, 20 percent of 788 clinical Holter recordings of 13-24 hours). Source: arxiv.org. Saturation forecast: Around December 2026. 7 models tracked.

Top models

#ModelScore
1Gemini 3 Flash64.33
2InternVL3.5-8B40.85
3MiniCPM-V-4.5-8B37.5
4Lingshu-7B27.74

Interactive version: theaggregate.ai/benchmark?slug=holtercare-bench-event-timing-video · How It Works · Data refreshed daily, snapshot 2026-09-29.