TeleCom-Bench - Wireless Network: leaderboard

Product-knowledge set of TeleCom-Bench (Xiao et al., ZTE Corporation, KDD 2026): open-ended questions on 5G and 4G radio-access equipment (base-station hardware, RF indicators, parameter configuration and optimization), built from vendor documentation with a knowledge graph. Three LLM judges vote on a 5-point scale, printed as a percentage (the mean of network-optimization and fault-diagnosis sets), with reasoning enabled, temperature 0.7 and a majority vote over three samples; higher is better.

Metric: LLM-judge score (%; open-ended wireless-network product-knowledge questions, three-judge vote on a 5-point scale). Source: arxiv.org. Saturation forecast: Around 2028. 6 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 32B (Thinking)73.04#960 (Qwen 3 32B)
2Qwen 3 235B A22B (Thinking)70.8#622 (Qwen 3 235B A22B)
3DeepSeek V3.2 (Thinking)45.89#403 (DeepSeek V3.2)
4GLM-4.7 (Thinking)22.63#365 (GLM-4.7)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=telecom-bench-wireless-network · How It Works · Data refreshed daily, snapshot 2026-11-12.