Reconstruction (Research Idea Recovery) - Materials: leaderboard

Metric: Match rate (%; the 117 materials seed papers; share of a model's five hypotheses, proposed in one call from a published paper's pre-publication bibliography only (titles and abstracts under anonymous IDs, the paper itself and later literature withheld), that an LLM judge matches to the held-out paper's idea; mean over the six other evaluated models as leave-one-out judges). Source: arxiv.org. Saturation forecast: Around 2029. 7 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=reconstruction-research-idea-recovery-materials · How It Works · Data refreshed daily, snapshot 2026-09-26.