EMRB - L3 Communication Theory: leaderboard

EMRB level accuracy for interpreting measurements in communication-theory terms for the link, solved by writing code over raw I/Q data (EMRB, arXiv 2608.24086v1, Appendix Table 5). Percent; higher is better; 13 models at temperature 0 with provider default reasoning.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.593.2#33
2Grok 4.592.3#54
3Claude Opus 4.788.3#51
4Claude Sonnet 4.680.2#94
5GLM-5.273.7#80
6DeepSeek V4 Pro72.8#112
7Gemini 3.5 Flash72.6#66
8MiniMax-M371.2#151
9DeepSeek V4 Flash67.5#155
10MiMo-V2.5-Pro59.4#167
11Gemini 3.1 Pro (Preview)57.8#64
12Kimi K2.648.6#113
13Llama 3.3 70B31.2#578

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=emrb-l3-communication-theory · How It Works · Data refreshed daily, snapshot 2026-11-05.