DiagFlowBench: leaderboard

Language models increasingly serve as advisory systems in maintenance operations. To prevent hallucination, recent systems ground these models in procedural documentation to constrain them to approved steps. In practice, however, operator queries frequently stray from this path, requiring models to recognise out-of-scope inputs mid-conversation, a dynamic that current benchmarks rarely prioritise.

Metric: Step Accuracy (self-reported). Source: benchmarklist.com. 10 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=diagflowbench · How It Works · Data refreshed daily, snapshot 2026-10-20.