SciPIvot - Options Only - Requested Max: leaderboard

SciPIvot (2026), 248 selected human-corrected scientific decisions from 26 projects; option-order-averaged choice accuracy; Options Only, requested effort Max. GPT models use Codex shell with read-only projects; Opus and Grok use a shared file/search client with shell, edits and web disabled. Client effort labels do not establish equivalent compute; these selected cases are not a representative population sample. Accuracy (%); higher is better.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around June 2028. 5 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6 Astra62.7#6
2Claude Opus 557.9#12
3GPT-5.6 Terra57.3#41
4GPT-5.6 Sol55.8#19
5Grok 4.653.4#26

No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #8 Gemini 4 Argon.

Interactive version: theaggregate.ai/benchmark?slug=scipivot-options-only-requested-max · How It Works · Data refreshed daily, snapshot 2026-10-20.