Harbor Adapters - Reasoning Gym (Terminus-2): leaderboard

Reasoning Gym, procedurally generated reasoning problems from 96 generators at easy and hard settings, all 576 tasks, where the agent may write code to compute its answer: the mean verifier reward in percent, higher is better. Each model runs in Terminus-2, the Harbor framework's bash-only terminal agent with no native web or image tools, at its provider's default settings, so results can differ from the same model in its vendor's own agent; the score is the mean of three trials (Harbor Adapters large-scale evaluation; Shi, Lin et al., 2026).

Metric: Mean reward (%; 576 tasks, mean of 3 trials). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)90.6#91
2Claude Opus 4.687.5#100
3Claude Sonnet 4.686.9#158
4Gemini 3 Flash (Preview)86.8#141
5GPT-5.4 (Medium)84.2#121 (GPT-5.4)
6GPT-5 Mini84.1#349
7Claude Haiku 4.580.3#568
8GPT-5 Nano67.1#888

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=harbor-adapters-reasoning-gym-terminus-2 · How It Works · Data refreshed daily, snapshot 2026-11-12.