GPT-6 Sol: benchmark results

Built for coding agents that edit files and operate software over multiple steps. Can switch reasoning off for routine work; tool use with reasoning requires the Responses API. Provider: OpenAI. Released 2026-09-22. Access: API.

Aggregate Rating 1907 ± 6, rank #17 of 1640 rated models, from 644 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Agent Arena - Steerability11.92Steerability (%)100
BizAgentBench - Goal64.7Rate (%)100
BizAgentBench - Protection100Rate (%)100
DeepsecBench40.75Recall-weighted F2 score (%)100
DeepsecBench-AA46.32Median F2 (%)100
Finance Agents Benchmark - Criterion Pass Rate83.4Share of the 231 rubric criteria passed (%), 50 tasks x 3 tr100
Kaggle FACTS Grounding85.22Score (%)100
OpenAI GPT-6 Astra System Card - Agentic Safe Completions - Codex Sensitive Personal Data85.4Safe completion rate (%)100
OpenAI GPT-6 Astra System Card - Challenging Prompts - Gore90Safe completion rate (%)100
OpenAI GPT-6 Astra System Card - Challenging Prompts - Sexual/Minors99.1Safe completion rate (%)100
OpenAI GPT-6.1 Terra System Card - AAV Capsid Packaging Prediction0.53Spearman rank correlation (higher is better)100
OpenAI GPT-6.1 Terra System Card - Blocker Deception (October 2026)8.05Blocker-related deception rate (%)100

Interactive version: theaggregate.ai/model?slug=gpt-6-sol · How It Works · Data refreshed daily, snapshot 2026-11-07.