SciPIvot - Project Record - Requested Low: leaderboard
SciPIvot (2026), 248 selected human-corrected scientific decisions from 26 projects; option-order-averaged choice accuracy; Project Record, requested effort Low. GPT models use Codex shell with read-only projects; Opus and Grok use a shared file/search client with shell, edits and web disabled. Client effort labels do not establish equivalent compute; these selected cases are not a representative population sample. Accuracy (%); higher is better.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around January 2028. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 57.7 | #6 |
| 2 | Claude Opus 5 | 40.5 | #12 |
| 3 | GPT-5.6 Sol | 36.1 | #19 |
| 4 | Grok 4.6 | 32.1 | #26 |
| 5 | GPT-5.6 Terra | 31.7 | #41 |
No result here: #3 Claude Opus 5.5, #7 GPT-6.1 Sol, #8 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=scipivot-project-record-requested-low · How It Works · Data refreshed daily, snapshot 2026-10-20.