TandemBench - Decision Accuracy: leaderboard
Multi-agent cooking coordination with exact-search optimal plans and paired optimality-verification questions. Native protocol accuracy (%). TandemBench English v1.0.0,1200questions; global state/rules/shared goal and candidate plans; reference outcomes from execution and exact search. Four cyclic option rotations; native decision models one response/rotation, general models four scored separately without voting. DA=optimal concrete-plan selection; VA averages detection when optimum removed and rejection when retained. Truncated/missing/multiple/infrastructure-failure outputs count incorrect. Native interfaces/calibration/precision retained perAppendixC; Qwen thinking disabled, MuseGlimmer low.
Metric: Native protocol accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 50 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.8 27B (Benchmark Sweep Run: source=TandemBench; general-generation; four-responses/rotation; thinking=disabled) | 82.8 | |
| 2 | Gemma 4 31B (Benchmark Sweep Run: source=TandemBench; general-generation; four-responses/rotation; native reasoning configuration) | 73.11 | |
| 3 | KnowLine-31B-Gen1 (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=31B; one-response/rotation; native AppendixC precision/calibration) | 62.5 | |
| 4 | Basal-Omni-1.0-Ultra (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=31B; one-response/rotation; native AppendixC precision/calibration) | 60.75 | |
| 5 | Quyet-1.0-Large (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=31B; one-response/rotation; native AppendixC precision/calibration) | 60.75 | |
| 6 | Gemma 4 26B A4B (Benchmark Sweep Run: source=TandemBench; general-generation; four-responses/rotation; native reasoning configuration) | 60.58 | |
| 7 | DOPEST-1.0-31B (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=31B; one-response/rotation; native AppendixC precision/calibration) | 60.38 | |
| 8 | PPLX-Decider-v1.2 (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=27B; one-response/rotation; native AppendixC precision/calibration) | 60.38 | |
| 9 | Muse Glimmer 30B (Benchmark Sweep Run: source=TandemBench; general-generation; four-responses/rotation; reasoning=low) | 59.64 | |
| 10 | PPLX-Decider-v1.1-27B (Benchmark Sweep Run: source=TandemBench; native-decision-interface; parameters=27B; one-response/rotation; native AppendixC precision/calibration) | 59.44 |
Interactive version: theaggregate.ai/benchmark?slug=tandembench-decision-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-06.