GPT-6 Sol: benchmark results
Built for coding agents that edit files and operate software over multiple steps. Can switch reasoning off for routine work; tool use with reasoning requires the Responses API. Provider: OpenAI. Released 2026-09-22. Access: API.
Aggregate Rating 1906 ± 7, rank #16 of 1640 rated models, from 517 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Agent Arena - Steerability | 11.92 | Steerability (%) | 100 |
| DeepsecBench | 40.91 | Recall-weighted F2 score (%) | 100 |
| Finance Agents Benchmark - Criterion Pass Rate | 83.4 | Share of the 231 rubric criteria passed (%), 50 tasks x 3 tr | 100 |
| Icelandic LLM - Generative Quality | 83.75 | Quality Score (%) | 100 |
| Kaggle FACTS Grounding | 85.22 | Score (%) | 100 |
| Next.js Agent Evals (Codex) - Success Rate | 97 | Evals passed, pass@4 (%) | 100 |
| OpenAI GPT-6 Astra System Card - Agentic Safe Completions - Codex Sensitive Personal Data | 85.4 | Safe completion rate (%) | 100 |
| OpenAI GPT-6 Astra System Card - Biology Refusal - Dual Use | 98 | Safe rate (%) | 100 |
| OpenAI GPT-6 Astra System Card - Challenging Prompts - Gore | 90 | Safe completion rate (%) | 100 |
| OpenAI GPT-6 Astra System Card - Challenging Prompts - Sexual | 98.4 | Safe completion rate (%) | 100 |
| OpenAI GPT-6 Astra System Card - Challenging Prompts - Sexual/Minors | 99.1 | Safe completion rate (%) | 100 |
| OpenAI GPT-6 Astra System Card - Multimodal Troubleshooting Virology | 50.6 | pass@1 (%) | 100 |
Interactive version: theaggregate.ai/model?slug=gpt-6-sol · How It Works · Data refreshed daily, snapshot 2026-10-13.