AutoArena Research - Decode latency at validation BPB < 1.05: leaderboard
AutoArena reports accepted research runs on 9 separate targets. Each run has a ceiling of 100 launches, including reference launches and failures. The research method chooses training and design changes; the outcome is the best generated artifact that meets the quality requirement (validation BPB < 1.05). It does not measure the throughput of the research LLM itself. Native comparison values, budgets, methods, providers, and explicitly named research LLMs are retained. Training time is discretized to 30-second checkpoints under the native rules; other metrics retain native full precision. Missing LLM metadata remains unknown and is not assigned an assumed Opus variant. Overall Elo is not added because it is derived from the same nine target outcomes. Metric: nopref_request_ms_median (ms).
Metric: nopref_request_ms_median (ms). Source: auto-research-arena.github.io. Saturation forecast: Rough model projection: around 2026. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | AutoArena autoscientists research system us.anthropic.claude-opus-5[1m] | 49.7 | |
| 2 | AutoArena gear research system us.anthropic.claude-opus-5[1m] | 56.01 | |
| 3 | AutoArena arbor research system None | 57.09 | |
| 4 | AutoArena beam-search research system us.anthropic.claude-opus-5[1m] | 65.15 | |
| 5 | AutoArena heuresis-map-elites research system None | 97.82 | |
| 6 | AutoArena sequential-search research system None | 98.56 |
Interactive version: theaggregate.ai/benchmark?slug=autoarena-research-decode-latency-at-validation-bpb-under-1-05 · How It Works · Data refreshed daily, snapshot 2026-10-28.