Draw the chart: curve shape

Our Benchmarks

Recall when Wikipedia interest rose and fell, independently of an article's popularity level.

Run Nov 10, 2026, 197 items.

Method

Each model sees only an English Wikipedia article title and draws its 120 monthly pageview values from January 2016 through December 2025. It receives no chart, page text, real values or tools. The same 197 articles are scored for every model; this tests recall of real-world quantities and events, not visual chart reading.

Articles come from a seeded sample of an October 2025 pageview dump, keeping complete ten-year series with a median of at least 3,000 monthly views. Eight articles renamed inside the window were removed so their missing earlier-title traffic would not count against a model.

One answer per chart at the provider's default reasoning setting, with one retry if it cannot be parsed. All 197 charts count: a final unparsable answer receives that article's flat-line reference score. OpenRouter calls allow 32,000 output tokens including reasoning. Claude models use the Claude CLI without a recorded output limit. Fable 5.2 and Carbon each reuse 28 answers to identical pilot prompts; Carbon's reused answers used a 16,000-token limit and finished below it.

The score is the mean, across the same 197 articles, of the Pearson correlation between predicted and real log10 monthly views. Higher is better, from −1 to 1; a constant curve scores 0. This measures the timing and pattern of rises and falls independently of the overall popularity guess.

Results

Draw the chart: curve shape: Pearson correlation (log10 views), highest first
#ModelPearson correlation (log10 views)
1Gemini 4 Carbon (OpenRouter · 32,000-token output limit (16,000 for 28 reused pilot answers))0.579456
2Claude Fable 5.2 (Claude CLI · output limit not recorded)0.513924
3Gemini 3.8 Flash (OpenRouter · 32,000-token output limit)0.503260
4GPT-6.1 Terra (OpenRouter · 32,000-token output limit)0.443478
5Muse Spark 1.3 (OpenRouter · 32,000-token output limit)0.393019
6Claude Opus 5.5 (Claude CLI · output limit not recorded)0.384865
7DeepSeek V4.1 Flash (1017) (OpenRouter · 32,000-token output limit)0.382010
8GLM-5.3 Flash (OpenRouter · 32,000-token output limit)0.366938
9Claude Sonnet 5.5 (Claude CLI · output limit not recorded)0.354767
10GPT-6 Luna (OpenRouter · 32,000-token output limit)0.349361
11Muse Ember (OpenRouter · 32,000-token output limit)0.323591
12MiMo-V2.6-Pro (OpenRouter · 32,000-token output limit)0.322690
13Claude Haiku 5.5 (Claude CLI · output limit not recorded)0.270466
14Mistral Large 4 (OpenRouter · 32,000-token output limit)0.264367
15Qwen 3.8 Flash (OpenRouter · 32,000-token output limit)0.233953
Average article (baseline)0.187651
16MiniMax-M3.1-Flash (OpenRouter · 32,000-token output limit)0.155557
Flat line (baseline)0.000000
  • The reference predictors know nothing about the article. They use the geometric mean of the other 196 articles: their average monthly curve, or a constant level as a flat line. They are references, not model observations.
  • The sample favors articles read around midday UTC in one October 2025 dump. Each model ran once. The study's chart-bootstrap intervals measure variation across articles, not variation from asking a model again.

Charts, exact prompt and every prediction

In the main leaderboard

These results are collected for the main leaderboard alongside external benchmarks. New scores enter the rating through the regular audited data updates. Comparisons with that rating therefore share some of its inputs.

How the rating works

Interactive version: theaggregate.ai/our-benchmarks/chart-recall-shape · How It Works · Data refreshed daily, snapshot 2026-11-12.