Into the Unknown (almost) - Scientist Bar: leaderboard

AI agents extend 15 published scientific studies and write follow-up papers. This score is the percentage of papers passing at least 90% of the checks for meeting the scientist’s requirements.

Metric: Papers passing Scientist Bar (%), requiring at least 90% of counted nodes in each applicable gate; 15 scientist-proposed open research follow-ups; GPT-6 Astra max via Codex SDK, full workspace, separated rubrics; per-node majority of four judgments (3/4 required); source agent SDK/CLI and effort retained; higher is better. Explicit zero results are retained.. Source: prometheus-eval.github.io. Source: raw.githubusercontent.com. Saturation forecast: Around August 2028. 9 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6 Astra (Max)26.67#5 (GPT-6 Astra)
2GPT-5.6 Sol (Max)20#18 (GPT-5.6 Sol)
3Claude Opus 5.5 (Max)20#3 (Claude Opus 5.5)
4Claude Fable 5 (Max)13.33#15 (Claude Fable 5)
5Kimi K30#30
6GLM-5.30#40
7Claude Opus 5 (Max)0#12 (Claude Opus 5)
8Claude Opus 4.8 (Max)0#38 (Claude Opus 4.8)
9DeepSeek V4 Pro (0813)0#53

No result here: #7 Gemini 4 Argon, #8 GPT-6.1 Sol, #9 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=into-the-unknown-almost-scientist-bar · How It Works · Data refreshed daily, snapshot 2026-10-16.