OpenAI GPT-6 Astra System Card - ProtocolQA Open-Ended: leaderboard
Table 33 (biological capability, High threshold) of OpenAI's GPT-6 Astra System Card, section 11 (GPT-6 Sol and GPT-6 Luna, added 2026-09-22): open-ended questions on troubleshooting flawed wet-lab protocols. pass@1, percent, higher is better; the card's High threshold is 54%. GPT-6 Sol and GPT-6 Luna only; the Astra section prints this evaluation as a figure.
Metric: pass@1 (%). Source: deploymentsafety.openai.com. Source: deploymentsafety.openai.com. Saturation forecast: Around 2029. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 45.37 | #5 |
| 2 | GPT-6 Sol | 44.4 | #17 |
| 3 | GPT-6.1 Sol | 40.74 | #6 |
| 4 | GPT-6 Luna | 34.9 | #62 |
No result here: #3 Claude Opus 5.5, #9 Gemini 4 Argon, #10 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=openai-gpt-6-astra-system-card-protocolqa-open-ended · How It Works · Data refreshed daily, snapshot 2026-11-07.