GPT-5.1 (Medium): benchmark results

GPT-5.1 evaluated at the medium reasoning-effort setting. Provider: OpenAI. Released 2025-11-12. Access: API.

Aggregate Rating 1707 ± 11, rank #337 of 2168 rated models, from 163 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FireBench - Item Ranking93Share of the 200 item ranking samples (%) in which the model100
HardSecBench - Refinement@5 (GPT-5.1 Collaborator) - Security53.88Requirement Pass Rate (%)100
Medmarks - CareQA Open89.02Score (%)100
Medmarks - MEDEC70.46Score (%)100
Medmarks - SCTpublic77.96Score (%)100
NLCO - Set-L - Feasibility Rate95.5Average feasibility rate: output satisfies every constraint 100
NLCO - Set-M - Feasibility Rate98Average feasibility rate: output satisfies every constraint 100
Medmarks - HEAD-QA v292.33Score (%)98.9
Medmarks - MedConceptsQA Easy99.97Score (%)98.9
Medmarks - MedMCQA84.65Score (%)98.9
Medmarks - MetaMedQA82.74Score (%)98.9
Medmarks - SuperGPQA Medicine Easy68.87Score (%)98.9

Interactive version: theaggregate.ai/model?slug=gpt-5-1-medium · How It Works · Data refreshed daily, snapshot 2026-10-20.