DecisionRAG Design MTRAG-UN86 - R@10: leaderboard

DecisionRAG v1 uses Jev (typesafe/jev-1.13), dense retrieval with Qwen3-Embedding-8B, BGE (bge-reranker-v2-m3), a Qwen3 8B reranker, and GPT 5 with low reasoning. Evaluation populations are MD2D with 4201 validation turns, CQA with 271 evidence-labeled development questions, MTRAG with 188 labeled IBM Cloud turns, and NQ with 500 seeded DAPR test questions. Main MTRAG gold labels are expanded using GPT 5 to judge the pooled top 5 documents; comparisons using the original official labels remain separate. Trained judges use Qwen3 Base at 1.7B, 4B, and 8B; their results are distinct from backbone language-model scores. All source-qualified harnesses and training variants remain separate. Design populations comprise 1832 MD2D training turns, 285 CQA paragraph-labeled design questions, and 86 MTRAG-UN questions (one per conversation). These are design results, not held-out evaluation. Metric: Accuracy (%).

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=decisionrag-design-mtrag-un86-r-10 · How It Works · Data refreshed daily, snapshot 2026-10-28.