GPT-5.4 (Medium): benchmark results

GPT-5.4 evaluated at the medium reasoning-effort setting. Provider: OpenAI. Released 2026-03-05. Access: API.

Aggregate Rating 1757 ± 7, rank #218 of 2168 rated models, from 225 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Asuka-Bench (OpenHands)90.1Cumulative weighted task pass rate (%) after three feedback 100
Asuka-Bench (OpenHands) - Criteria Pass Rate95.1Cumulative weighted criteria pass rate (%) after three round100
Asuka-Bench (OpenHands) - Project Completion52Project completion rate (%) under OpenHands: the share of th100
CADWorld17.5Task success rate (%; 200 long-horizon FreeCAD tasks in 11 w100
DailyReport (Claude Code)2.87User preference score (1-4: unhelpful, deficient, acceptable100
DailyReport (Claude Code) - Factuality81.3Factuality (0-1 scaled to %), the share of extracted objecti100
DailyReport (Claude Code) - Rationality93.3Rationality (0-1 scaled to %), rubric scores of 0, 0.5 or 1 100
DailyReport (Claude Code) - SubTask Pass47.8Share of subtasks (0-1 scaled to %) that satisfy every rubri100
DailyReport (Search Tools)2.89User preference score (1-4: unhelpful, deficient, acceptable100
DailyReport (Search Tools) - Factuality83.5Factuality (0-1 scaled to %), the share of extracted objecti100
DailyReport (Search Tools) - Rationality93Rationality (0-1 scaled to %), rubric scores of 0, 0.5 or 1 100
DailyReport (Search Tools) - SubTask Pass48.4Share of subtasks (0-1 scaled to %) that satisfy every rubri100

Interactive version: theaggregate.ai/model?slug=gpt-5-4-medium · How It Works · Data refreshed daily, snapshot 2026-10-20.