HarnessOpt-Bench - GAIA: leaderboard
Metric: Normalized gain ((held-out score minus seed score) / (1 minus seed score); negative when the nominated harness is worse than the seed; mean over the contestant's optimization rounds, each held-out case scored three times; GAIA assistant questions with a gpt-5.4-mini target agent; the seed is a non-functional stub scoring 0, so the gain equals the built agent's held-out score, 66 test cases; the optimizer edits the seed harness under fixed development and validation evaluation budgets and never sees the test partition). Source: arxiv.org. Saturation forecast: Around November 2027. 20 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 5 | 0.47 |
| 2 | Kimi K3 | 0.34 |
| 3 | GPT-5.6 Sol | 0.31 |
| 4 | Claude Sonnet 5 | 0.25 |
| 5 | GPT-5.6 Terra | 0.17 |
Interactive version: theaggregate.ai/benchmark?slug=harnessopt-bench-gaia · How It Works · Data refreshed daily, snapshot 2026-09-29.