GPT-5.1 Codex: benchmark results

OpenAI's Codex-specialized GPT-5.1 model for coding and software-agent workloads. Provider: OpenAI. Released 2025-11-13. Access: API.

Aggregate Rating 1721 ± 10, rank #159 of 1656 rated models, from 172 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FeatureBench12.5Resolved rate (%): share of tasks whose patched repository p100
PrepBench54.9End-to-End Prep-Code Acc. (self-reported)100
PrepBench - Code-to-Workflow Translation67.7Translation accuracy (%): given the ground-truth preparation100
PrepBench - GUI Workflow34.6End-to-end GUI workflow accuracy (%): from the original ambi100
PrepBench - Interactive Disambiguation51.4Disambiguation F1 (0-100) of the agent's clarification quest100
PrepBench - Prep-Code Generation85.3Prep-code accuracy (%) from the disambiguated request with a100
SWE-Lancer66.3Score (%)100
Sonar LLM Leaderboard - Java - Bug Density0.52Bugs per 1,000 lines of code (lower is better)98.6
AA AIME 202595.67Accuracy (%)97.2
AI Chess Leaderboard (Reasoning)1743Elo97.1
AA LiveCodeBench84.87Pass@1 (%)95.9
AA MMLU-Pro86.01Accuracy (%)94.5

Interactive version: theaggregate.ai/model?slug=gpt-5-1-codex · How It Works · Data refreshed daily, snapshot 2026-10-20.