Harbor Adapters - AA-LCR (Terminus-2): leaderboard

AA-LCR, reasoning over document sets of about 100,000 tokens, 99 of its 100 questions: accuracy in percent, graded by the official equality-checker prompt, higher is better. Each model runs in Terminus-2, the Harbor framework's bash-only terminal agent with no native web or image tools, at its provider's default settings, so results can differ from the same model in its vendor's own agent; the score is the mean of three trials (Harbor Adapters large-scale evaluation; Shi, Lin et al., 2026).

Metric: Accuracy (%; 99 questions, LLM equality checker, mean of 3 trials). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)74.4#91
2Claude Sonnet 4.666.3#158
3Gemini 3 Flash (Preview)64.3#141
4Claude Opus 4.661.6#100
5Claude Haiku 4.560.6#568
6GPT-5.4 (Medium)52.5#121 (GPT-5.4)
7GPT-5 Mini32#349
8GPT-5 Nano13.1#888

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=harbor-adapters-aa-lcr-terminus-2 · How It Works · Data refreshed daily, snapshot 2026-11-12.