Holtercare-Bench - Event Timing (Text): leaderboard

Metric: Accuracy (%; multiple-choice closed QA on the millisecond timestamps of every occurrence of an abnormal event, among close distractors; the ECG lead given as text, values in millivolts to three decimals, truncated where it exceeds the input limit; zero-shot on the held-out test cases of Holtercare-23K, 20 percent of 788 clinical Holter recordings of 13-24 hours). Source: arxiv.org. Saturation forecast: Around 2028. 13 models tracked.

Top models

#ModelScore
1Gemini 3 Flash62.5
2InternVL3.5-8B47.26
3GPT-5 Mini33.54
4Phi-4 Mini Instruct33.23
5Claude Haiku 4.531.71
6MedGemma 1.5 4B30.79
7MiniCPM-V-4.5-8B28.05
8Lingshu-7B24.7

Interactive version: theaggregate.ai/benchmark?slug=holtercare-bench-event-timing-text · How It Works · Data refreshed daily, snapshot 2026-09-29.