TimeSeriesExamAgent - PTB-XL: leaderboard

Time-series reasoning on the PTB-XL 12-lead ECG exam (151 questions) that TimeSeriesExamAgent (2026) generates from real data with LLM-written, LLM-verified and difficulty-filtered question templates; the series is shown as a plot. Multiple-choice accuracy in percent (chance 25); higher is better.

Metric: Accuracy (%, times 100) on the PTB-XL 12-lead ECG exam (151 questions): multiple-choice questions generated by TimeSeriesExamAgent from real data (Claude Sonnet 4 templates verified by gpt-4o and filtered so that gpt-4o does not score below gpt-4o-mini), time series given as plots, default API parameters; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 5 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemma 3 27B (IT)51.7#1341
2TimeSeriesExamAgent Qwen2.5-VL-Instruct (checkpoint unspecified)49
3O3 Mini47.7#552
4Gemini 2.5 Pro45.7#280
5GPT-545#185

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=timeseriesexamagent-ptb-xl · How It Works · Data refreshed daily, snapshot 2026-11-22.