SciPIvot - Project Record - Requested High: leaderboard
SciPIvot (2026), 248 selected human-corrected scientific decisions from 26 projects; option-order-averaged choice accuracy; Project Record, requested effort High. GPT models use Codex shell with read-only projects; Opus and Grok use a shared file/search client with shell, edits and web disabled. Client effort labels do not establish equivalent compute; these selected cases are not a representative population sample. Accuracy (%); higher is better.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around October 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 62.1 | #6 |
| 2 | Claude Opus 5 | 43.3 | #12 |
| 3 | Grok 4.6 | 38.1 | #26 |
| 4 | GPT-5.6 Sol | 35.9 | #19 |
| 5 | GPT-5.6 Terra | 30.4 | #41 |
No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #8 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=scipivot-project-record-requested-high · How It Works · Data refreshed daily, snapshot 2026-10-20.