EMRB - L5 Spectrum Survey and System Design: leaderboard

EMRB level accuracy for surveying the spectrum and designing communication systems such as OFDM configurations, solved by writing code over raw I/Q data (EMRB, arXiv 2608.24086v1, Appendix Table 5). Percent; higher is better; 13 models at temperature 0 with provider default reasoning.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around April 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Grok 4.539.8#54
2Gemini 3.1 Pro (Preview)34.8#64
3GPT-5.534.5#33
4Gemini 3.5 Flash28.3#66
5Claude Opus 4.720.5#51
6GLM-5.220#80
7MiniMax-M319.8#151
8DeepSeek V4 Pro18.7#112
9DeepSeek V4 Flash16.5#155
10MiMo-V2.5-Pro16.3#167
11Claude Sonnet 4.615.8#94
12Kimi K2.612.5#113
13Llama 3.3 70B2.4#578

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=emrb-l5-spectrum-survey-and-system-design · How It Works · Data refreshed daily, snapshot 2026-11-05.