EpiCurveBench - Manually Annotated Set: leaderboard
Metric: EpiCurveSimilarity, ECS (%): edit distance with real penalty between each extracted and ground-truth series (gap penalty 1, value differences normalized by the y-axis range and counted fully above 1%), scaled to 0-100 and averaged over matched series per chart (0 for a missed series), then over Set 2 only: the 100 stylistically diverse epidemic curves without source tables, each digitized independently by two annotators with WebPlotDigitizer; the model returns the chart data as a TSV from one generic extraction prompt; the general-purpose VLMs at high reasoning effort, the specialized chart extractors in their single configuration; higher is better. Source: arxiv.org. Saturation forecast: Around March 2028. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.2 (High) | 50 |
| 2 | Claude Opus 4.5 (High) | 41.4 |
| 3 | Qwen 3 VL 235B A22B Instruct | 34.7 |
Interactive version: theaggregate.ai/benchmark?slug=epicurvebench-manually-annotated-set · How It Works · Data refreshed daily, snapshot 2026-10-07.