Into the Unknown (strict) - Scientist Bar: leaderboard

AI agents extend 15 published scientific studies and write follow-up papers. This score is the percentage of papers passing every check for meeting the scientist’s requirements.

Metric: Papers passing Scientist Bar (%), requiring all counted nodes in each applicable gate; 15 scientist-proposed open research follow-ups; GPT-6 Astra max via Codex SDK, full workspace, separated rubrics; per-node majority of four judgments (3/4 required); source agent SDK/CLI and effort retained; higher is better. Explicit zero results are retained.. Source: prometheus-eval.github.io. Source: raw.githubusercontent.com. Saturation forecast: Around 2034. 9 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K30#30
2GLM-5.30#40
3GPT-5.6 Sol (Max)0#18 (GPT-5.6 Sol)
4Claude Opus 5 (Max)0#12 (Claude Opus 5)
5GPT-6 Astra (Max)0#5 (GPT-6 Astra)
6Claude Opus 4.8 (Max)0#38 (Claude Opus 4.8)
7DeepSeek V4 Pro (0813)0#53
8Claude Fable 5 (Max)0#15 (Claude Fable 5)
9Claude Opus 5.5 (Max)0#3 (Claude Opus 5.5)

No result here: #7 Gemini 4 Argon, #8 GPT-6.1 Sol, #9 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=into-the-unknown-strict-scientist-bar · How It Works · Data refreshed daily, snapshot 2026-10-16.