nnInteractive Agents - Unguided All 14 Images: leaderboard

nnInteractive Agents - Unguided All 14 Images. The nnInteractive paper evaluates its public v1.0 segmentation weights on one RTX 4090 through an MCP tool interface. Codex 0.162 uses GPT-6.1 Sol at medium reasoning effort, and Claude Code 2.1 uses Claude Opus 5.5 at medium effort. Guided and unguided requests are separate conditions. There are 51 targets in 14 images: 25 radiology targets and 26 targets in leg, mouse, and ant images. Dice is averaged over targets within each image, then over images. Agent scores average three independent repetitions; reported uncertainty describes variation between repetitions. The radiology cohort without adrenal_ct contains eight images. Reported metric: Mean Dice (0–1).

Metric: Mean Dice (0–1). Source: arxiv.org. Saturation forecast: Around February 2027. 2 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6.1 Sol (Medium)0.84#7 (GPT-6.1 Sol)
2Claude Opus 5.5 (Medium)0.81#5 (Claude Opus 5.5)

No result here: #6 GPT-6 Astra, #8 Gemini 4 Argon, #9 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=nninteractive-agents-unguided-all-14-images · How It Works · Data refreshed daily, snapshot 2026-10-25.