Reconstruction (Research Idea Recovery) - Machine Learning: leaderboard

Metric: Match rate (%; the 120 machine learning seed papers; share of a model's five hypotheses, proposed in one call from a published paper's pre-publication bibliography only (titles and abstracts under anonymous IDs, the paper itself and later literature withheld), that an LLM judge matches to the held-out paper's idea; mean over the six other evaluated models as leave-one-out judges). Source: arxiv.org. Saturation forecast: Around 2030. 7 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=reconstruction-research-idea-recovery-machine-learning · How It Works · Data refreshed daily, snapshot 2026-09-26.