NetAgentBench - Success Rate: leaderboard

NetAgentBench (2026) has LLM agents configure emulated network devices over up to 100 turns on CCNA-, CCNP OSPF- and CCIE BGP-level tasks, 25 runs each, and checks the resulting device state rather than the commands. This board is the share of runs whose final state satisfies every task property, in percent; higher is better.

Metric: Success rate (%): share of runs whose final device state satisfies every task property, over 75 runs per model (three network-configuration tasks at CCNA, CCNP OSPF and CCIE BGP level, 25 repetitions each) on emulated routers, at most 100 turns and 30 minutes per run; higher is better. Source: arxiv.org. Saturation forecast: Around May 2027. 4 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1GPT-524#178
2Qwen 3 Coder 30B A3B Instruct12#1012
3Llama 3.3 70B Instruct6.7#1385
4Qwen3 Coder Next5.3#725

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=netagentbench-success-rate · How It Works · Data refreshed daily, snapshot 2026-11-21.