CUJBench (Full Agent): leaderboard

Metric: Root-cause accuracy: single-prediction root-cause accuracy (A@1, %: component and fault type both correct; a run that never submits counts as wrong) on the 25-scenario CUJBench evaluation subset of browser-to-backend failure diagnoses (OpenTelemetry Demo and Tractor Store applications), one run per scenario; ReAct tool loop capped at 15 turns over all 12 evidence tools (visual, browser and backend); higher is better. Source: arxiv.org. Saturation forecast: Around 2032. 6 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=cujbench-full-agent · How It Works · Data refreshed daily, snapshot 2026-10-07.