SAGE (Literature Search) - Short-Form (Healthcare): leaderboard

Metric: Exact match (%, 0-100): the target paper appears in the answer text or its citations; the 150 healthcare short-form questions of SAGE, each built from a seed paper's metadata, figure and table details and reference overlap with related papers, with one ground-truth paper; deep research agents with their native web search: GPT-5 series through the API at medium reasoning effort with web search enabled, Gemini 2.5 with dynamic thinking and web search, the open DR Tulu agent served with vLLM; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1GPT-578.7#91
2GPT-5 Mini72#176
3dr-tulu58#188
4Gemini 2.5 Pro47.8#145
5GPT-5 Nano46.7#415
6Gemini 2.5 Flash43.7#237

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=sage-literature-search-short-form-healthcare · How It Works · Data refreshed daily, snapshot 2026-10-11.