AARRI-Bench (Claude Code): leaderboard

AARRI-Bench (Act As a Real Research Intern, 2026) is a set of 82 hand-crafted AI-research tasks graded by unit tests, testing whether an agent harness and model behave like a careful human researcher. The board is the percentage of tasks solved in full, every unit test passing, with the Claude Code harness; higher is better.

Metric: Task success rate (%) under the 0/1 reward (a task counts only when every one of its unit tests passes) over the 82 hand-crafted AI-research-intern tasks in four scenario categories; Harbor containerized runs, Claude Code agent harness; a configuration's tasks without a valid run are left out of its denominator; higher is better. Source: arxiv.org. Saturation forecast: Around May 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.762.2#79
2Qwen 3.6 Plus56.3#222
3MiniMax-M2.756.1#518
4GPT-5.3 Codex53.1#116
5Claude Sonnet 4.652.4#161
6Kimi K2.651.3#178

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=aarri-bench-claude-code · How It Works · Data refreshed daily, snapshot 2026-11-13.