TeamBench - Restricted: leaderboard

Metric: Pass rate (%) on the 90-task stratified TeamBench leaderboard subset (operating-system-enforced role separation in Docker sandboxes; a run passes when every check of the task's deterministic shell-script grader passes, and a run failing only the attestation check counts as a pass), temperature 0, with one agent holding only the Executor's capabilities (it edits the workspace and runs commands but cannot read the full specification or write the attestation); higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 13 models tracked.

Top models

#ModelScore
1GPT-5.435.6
2Claude Opus 4.733.3
3Claude Haiku 4.531.1
4Claude Sonnet 4.627.8
5Gemma 4 31B25.6
6GPT-5.4 Mini23.3
7Gemini 3.1 Pro (Preview)22.2
8Gemini 3.1 Flash Lite21.1
9Gemini 3 Flash18.9
10GPT-OSS-20B17.8

Interactive version: theaggregate.ai/benchmark?slug=teambench-restricted · How It Works · Data refreshed daily, snapshot 2026-10-07.