ViBench 2.0 - Historical GPT Public8 Plan Pass: leaderboard
Long-horizon greenfield software building with sequential features and browser-graded test plans. Browser test-plan pass rate (%). ViBench2 native public OpenHands-SDK harness, medium reasoning, temperature1.0, max300steps and2hours per stage, summarization past200k tokens; provider default output/context limits and recommended open-weight top-p. Independent cohort ran2.0.1.beta, historical-GPT cohort2.0.5 with matching task/plan hashes. Four independent builds per product. Pass@1 requires every browser-graded plan to pass; Plan Pass is the mean fraction of plans passed. Grader/seeding Opus5.5 medium.
Metric: Browser test-plan pass rate (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6.1 Sol (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 94.9 | |
| 2 | GPT-6.1 Terra (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 94.5 | |
| 3 | GPT-6 Sol (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 84 | |
| 4 | GPT-5.6 Sol (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 67.5 | |
| 5 | GPT-6 Luna (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 59.8 | |
| 6 | GPT-5.5 (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 51.5 | |
| 7 | GPT-5.4 (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 41.5 | |
| 8 | GPT-5.6 Terra (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 26.1 | |
| 9 | GPT-5.6 Luna (Benchmark Sweep Run: source=ViBench2; OpenHandsSDK; medium; temperature1.0; cohort=historical-GPT-public8) | 6.6 |
Interactive version: theaggregate.ai/benchmark?slug=vibench-2-0-historical-gpt-public8-plan-pass · How It Works · Data refreshed daily, snapshot 2026-11-06.