Harbor Adapters - SpreadsheetBench (Terminus-2): leaderboard

SpreadsheetBench, spreadsheet manipulation from real Excel-forum questions, here 200 of its 400 tasks: the percentage of workbooks whose designated cells match the gold values, higher is better. Each model runs in Terminus-2, the Harbor framework's bash-only terminal agent with no native web or image tools, at its provider's default settings, so results can differ from the same model in its vendor's own agent; the score is the mean of three trials (Harbor Adapters large-scale evaluation; Shi, Lin et al., 2026).

Metric: Pass rate (%; 200 tasks, mean of 3 trials). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.683.2#100
2Claude Sonnet 4.680.3#158
3Gemini 3.1 Pro (Preview)79.5#91
4Gemini 3 Flash (Preview)75.5#141
5GPT-5.4 (Medium)64.3#121 (GPT-5.4)
6Claude Haiku 4.556#568
7GPT-5 Mini45.2#349
8GPT-5 Nano26.3#888

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=harbor-adapters-spreadsheetbench-terminus-2 · How It Works · Data refreshed daily, snapshot 2026-11-12.