SciPIvot - Options Only - Requested Low: leaderboard
SciPIvot (2026), 248 selected human-corrected scientific decisions from 26 projects; option-order-averaged choice accuracy; Options Only, requested effort Low. GPT models use Codex shell with read-only projects; Opus and Grok use a shared file/search client with shell, edits and web disabled. Client effort labels do not establish equivalent compute; these selected cases are not a representative population sample. Accuracy (%); higher is better.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around March 2028. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 64.5 | #6 |
| 2 | Claude Opus 5 | 59.5 | #12 |
| 3 | GPT-5.6 Terra | 56.5 | #41 |
| 4 | GPT-5.6 Sol | 54.4 | #19 |
| 5 | Grok 4.6 | 53.8 | #26 |
No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #8 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=scipivot-options-only-requested-low · How It Works · Data refreshed daily, snapshot 2026-10-20.