HarnessPro - GPT-5.5 Codex - SWE-bench Pro: leaderboard

HarnessPro (2026): label-free harness development, GPT-5.5 Codex execution setup. Official held-out evaluations; baseline GPT-5.5 high effort, GLM-5.2 max for Terminal-Bench/SWE and high for ProgramBench. HarnessPro evolves effort dynamically; Lite/Medium/Heavy are optimization cost weights, not fixed provider reasoning settings. ProgramBench uses macro-averaged within-task test pass fraction. Each method remains a distinct model-plus-harness system; cost, timing and standard deviations are not capability scores. Pass Rate (%); higher is better.

Metric: Pass Rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 10 models tracked.

Top models

#ModelScoreOverall rank
1HarnessPro Study GPT-5.5 Codex - HarnessPro-Heavy objective system80.7
2HarnessPro Study GPT-5.5 Codex - RHO objective system80
3HarnessPro Study GPT-5.5 Codex - RHO+Iteration objective system80
4HarnessPro Study GPT-5.5 Codex - HarnessPro-Medium objective system79
5HarnessPro Study GPT-5.5 Codex - Balance objective system78
6HarnessPro Study GPT-5.5 Codex - HarnessPro-Lite objective system72.3
7HarnessPro Study GPT-5.5 Codex - Dynamic Cheatsheet objective system62
8HarnessPro Study GPT-5.5 Codex - Sleep-time Compute objective system62
9HarnessPro Study GPT-5.5 Codex - ReasoningBank objective system61
10HarnessPro Study GPT-5.5 Codex - Vanilla objective system59

Interactive version: theaggregate.ai/benchmark?slug=harnesspro-gpt-5-5-codex-swe-bench-pro · How It Works · Data refreshed daily, snapshot 2026-10-21.