EMRB - L1 Basic Measurement: leaderboard

EMRB level accuracy for reading basic quantities such as source frequencies, power, noise floor and modulation from a raw capture given a preliminary scan summary, solved by writing code over raw I/Q data (EMRB, arXiv 2608.24086v1, Appendix Table 5). Percent; higher is better; 13 models at temperature 0 with provider default reasoning.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.595.8#33
2Grok 4.593.4#54
3GLM-5.292.9#80
4Gemini 3.5 Flash91.9#66
5Gemini 3.1 Pro (Preview)91.7#64
6Claude Sonnet 4.691.5#94
7DeepSeek V4 Flash91.2#155
8DeepSeek V4 Pro90.8#112
9MiniMax-M387.7#151
10Claude Opus 4.784#51
11MiMo-V2.5-Pro83.7#167
12Kimi K2.666.4#113
13Llama 3.3 70B52.5#578

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=emrb-l1-basic-measurement · How It Works · Data refreshed daily, snapshot 2026-11-05.