EvoRouter - Out-of-Domain Average: leaderboard
EvoRouter v1 compares multi-agent routing configurations with a fixed resource pool. It uses 1300 in-domain test questions across 5 domains, plus 175 LiveCodeBench and 200 BBH-LD out-of-domain questions. Results average 3 runs; the mean correct count is rounded before denominator normalization. Pool models use temperature 1 and an output budget of 1024 tokens (4096 for code). Nonvision models receive an explicit image-invisibility placeholder on multimodal tasks. Router 4B and 8B are trained Qwen3 variants; LLaMa 8B is a trained Llama3.1 variant. Systems without model selection use GLM-5. Distinct trained-model, router, and harness identities are preserved. Metric: Accuracy (%).
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 22 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | EvoRouter study EvoRouter-LLaMa-8B | 78.93 | |
| 2 | EvoRouter study EvoRouter-8B | 76.8 | |
| 3 | EvoRouter study EvoRouter-4B | 74.67 | |
| 4 | EvoRouter study MAS-Orchestra | 66.93 | |
| 5 | EvoRouter study RCR-Router | 65.33 | |
| 6 | EvoRouter study xRouter | 64.8 | |
| 7 | EvoRouter study Qwen3.5-397B-A17B | 63.73 | |
| 8 | EvoRouter study MasRouter | 61.33 | |
| 9 | EvoRouter study GLM-5 | 60.27 | |
| 10 | EvoRouter study Qwen3.5-122B-A10B | 59.2 |
Interactive version: theaggregate.ai/benchmark?slug=evorouter-out-of-domain-average · How It Works · Data refreshed daily, snapshot 2026-10-28.