EMRB - L2 Signal Processing Methodology: leaderboard

EMRB level accuracy for choosing and implementing the right signal-processing method, such as the correct bandwidth definition, for a measurement, solved by writing code over raw I/Q data (EMRB, arXiv 2608.24086v1, Appendix Table 5). Percent; higher is better; 13 models at temperature 0 with provider default reasoning.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.788.7#51
2Grok 4.586.4#54
3GPT-5.586#33
4GLM-5.283.8#80
5Claude Sonnet 4.682.6#94
6Kimi K2.679.7#113
7Gemini 3.1 Pro (Preview)79.6#64
8DeepSeek V4 Pro77.9#112
9MiMo-V2.5-Pro72#167
10DeepSeek V4 Flash65.1#155
11MiniMax-M362.5#151
12Gemini 3.5 Flash46.3#66
13Llama 3.3 70B22.7#578

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=emrb-l2-signal-processing-methodology · How It Works · Data refreshed daily, snapshot 2026-11-05.