TimeSeriesExamAgent - MIMIC-IV Waveform: leaderboard

Metric: Accuracy (%, times 100) on the MIMIC-IV Waveform exam (205 questions): multiple-choice questions generated by TimeSeriesExamAgent from real data (Claude Sonnet 4 templates verified by gpt-4o and filtered so that gpt-4o does not score below gpt-4o-mini), time series given as plots, default API parameters; higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 6 models tracked.

Top models

#ModelScore
1GPT-542.4
2Gemini 2.5 Pro40
3Gemma 3 27B (IT)37
4O3 Mini35.6

Interactive version: theaggregate.ai/benchmark?slug=timeseriesexamagent-mimic-iv-waveform · How It Works · Data refreshed daily, snapshot 2026-10-07.