NetAgentBench: leaderboard

Metric: Mean combined score (0 to 1): the equal-weight mean of property completeness of the final device state, re-application robustness and the share of valid commands, averaged over 75 runs per model (three network-configuration tasks at CCNA, CCNP OSPF and CCIE BGP level, 25 repetitions each) on emulated routers, at most 100 turns and 30 minutes per run; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.

Top models

#ModelScore
1GPT-50.51
2Qwen 3 Coder 30B A3B Instruct0.31
3Llama 3.3 70B Instruct0.23
4Qwen3 Coder Next0.22

Interactive version: theaggregate.ai/benchmark?slug=netagentbench · How It Works · Data refreshed daily, snapshot 2026-10-07.