The Aggregate - Chart Recall - Shape: leaderboard
The shape score from Chart Recall: models draw 120 monthly pageview estimates for each of 197 English Wikipedia articles using only its title. The score is the mean Pearson correlation between the predicted and observed log10 curves, with higher values better. It measures the timing of rises, falls and spikes separately from the overall popularity estimate. It uses the same answers as the reconstruction-error board, so the two scores are related measurements.
Metric: Pearson correlation (log10 views). Source: theaggregate.ai. Source: theaggregate.ai. Saturation forecast: Around August 2027. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 4 Carbon | 0.58 | #2 |
| 2 | Claude Fable 5.2 | 0.51 | #1 |
| 3 | Gemini 3.8 Flash | 0.5 | #36 |
| 4 | GPT-6.1 Terra | 0.44 | #19 |
| 5 | Muse Spark 1.3 | 0.39 | #42 |
| 6 | Claude Opus 5.5 | 0.38 | #5 |
| 7 | DeepSeek V4.1 Flash (1017) | 0.38 | #38 |
| 8 | GLM-5.3 Flash | 0.37 | #119 |
| 9 | Claude Sonnet 5.5 | 0.35 | #18 |
| 10 | GPT-6 Luna | 0.35 | #93 |
| 11 | Muse Ember | 0.32 | #54 |
| 12 | MiMo-V2.6-Pro | 0.32 | #68 |
| 13 | Claude Haiku 5.5 | 0.27 | #64 |
| 14 | Mistral Large 4 | 0.26 | #125 |
| 15 | Qwen 3.8 Flash | 0.23 | #109 |
No result here: #6 GPT-6 Astra, #10 GPT-6.1 Sol.
Method and evidence
Run by The Aggregate · Nov 10, 2026
Read method and notes
Each model sees only an English Wikipedia article title and draws its 120 monthly pageview values from January 2016 through December 2025. It receives no chart, page text, real values or tools. The same 197 articles are scored for every model; this tests recall of real-world quantities and events, not visual chart reading.
Articles come from a seeded sample of an October 2025 pageview dump, keeping complete ten-year series with a median of at least 3,000 monthly views. Eight articles renamed inside the window were removed so their missing earlier-title traffic would not count against a model.
One answer per chart at the provider's default reasoning setting, with one retry if it cannot be parsed. All 197 charts count: a final unparsable answer receives that article's flat-line reference score. OpenRouter calls allow 32,000 output tokens including reasoning. Claude models use the Claude CLI without a recorded output limit. Fable 5.2 and Carbon each reuse 28 answers to identical pilot prompts; Carbon's reused answers used a 16,000-token limit and finished below it.
The score is the mean, across the same 197 articles, of the Pearson correlation between predicted and real log10 monthly views. Higher is better, from −1 to 1; a constant curve scores 0. This measures the timing and pattern of rises and falls independently of the overall popularity guess.
- Average article (baseline): 0.187651
- Flat line (baseline): 0.000000
- The reference predictors know nothing about the article. They use the geometric mean of the other 196 articles: their average monthly curve, or a constant level as a flat line. They are references, not model observations.
- The sample favors articles read around midday UTC in one October 2025 dump. Each model ran once. The study's chart-bootstrap intervals measure variation across articles, not variation from asking a model again.
Interactive version: theaggregate.ai/benchmark?slug=the-aggregate-chart-recall-shape · How It Works · Data refreshed daily, snapshot 2026-11-12.