The Aggregate - Chart Recall: leaderboard
Draw ten years of monthly English Wikipedia pageviews from an article title alone, without tools or a chart to look at. Sixteen models reconstruct the same 197 articles from January 2016 to December 2025. The score averages each article’s root mean squared error in log10 views, with lower values better; an error near 0.30 corresponds roughly to a factor-of-two miss. The separate shape score measures whether the rises and falls are in the right places.
Metric: RMSE (log10 views). Source: theaggregate.ai. Source: theaggregate.ai. Saturation forecast: Around January 2028. 16 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6.1 Terra | 0.27 | #19 |
| 2 | Gemini 4 Carbon | 0.27 | #2 |
| 3 | Gemini 3.8 Flash | 0.28 | #36 |
| 4 | Claude Opus 5.5 | 0.29 | #5 |
| 5 | Claude Fable 5.2 | 0.29 | #1 |
| 6 | GLM-5.3 Flash | 0.41 | #119 |
| 7 | Muse Spark 1.3 | 0.41 | #42 |
| 8 | MiMo-V2.6-Pro | 0.43 | #68 |
| 9 | DeepSeek V4.1 Flash (1017) | 0.53 | #38 |
| 10 | Muse Ember | 0.53 | #54 |
| 11 | Mistral Large 4 | 0.57 | #125 |
| 12 | MiniMax-M3.1-Flash | 0.59 | #104 |
| 13 | Claude Sonnet 5.5 | 0.67 | #18 |
| 14 | Qwen 3.8 Flash | 0.73 | #109 |
| 15 | GPT-6 Luna | 0.81 | #93 |
No result here: #6 GPT-6 Astra, #10 GPT-6.1 Sol.
Method and evidence
Run by The Aggregate · Nov 10, 2026
Read method and notes
Each model sees only an English Wikipedia article title and draws its 120 monthly pageview values from January 2016 through December 2025. It receives no chart, page text, real values or tools. The same 197 articles are scored for every model; this tests recall of real-world quantities and events, not visual chart reading.
Articles come from a seeded sample of an October 2025 pageview dump, keeping complete ten-year series with a median of at least 3,000 monthly views. Eight articles renamed inside the window were removed so their missing earlier-title traffic would not count against a model.
One answer per chart at the provider's default reasoning setting, with one retry if it cannot be parsed. All 197 charts count: a final unparsable answer receives that article's flat-line reference score. OpenRouter calls allow 32,000 output tokens including reasoning. Claude models use the Claude CLI without a recorded output limit. Fable 5.2 and Carbon each reuse 28 answers to identical pilot prompts; Carbon's reused answers used a 16,000-token limit and finished below it.
The score is the mean, across the 197 articles, of the root mean squared difference between predicted and real log10 monthly views. Lower is better; 0 is exact. An error of 0.30 corresponds to a typical multiplicative miss of about 2×. This score measures both the article's popularity level and the curve's shape.
- Average article (baseline): 0.402218
- Flat line (baseline): 0.403034
- The reference predictors know nothing about the article. They use the geometric mean of the other 196 articles: their average monthly curve, or a constant level as a flat line. They are references, not model observations.
- The sample favors articles read around midday UTC in one October 2025 dump. Each model ran once. The study's chart-bootstrap intervals measure variation across articles, not variation from asking a model again.
Interactive version: theaggregate.ai/benchmark?slug=the-aggregate-chart-recall · How It Works · Data refreshed daily, snapshot 2026-11-12.