PagerDuty SRE (Claude Code) - Misdirection: leaderboard

Misdirection (0-1), Claude Code fixed-harness cohort; 17 injected Kubernetes financial-app fault scenarios, one trial per agent, default config except model; same Grafana MELT, source code and alerts, no direct Kubernetes substrate or remediation. Three-provider judge ensemble. Lower is better.

Metric: Misdirection (0-1), Claude Code fixed-harness cohort; 17 injected Kubernetes financial-app fault scenarios, one trial per agent, default config except model; same Grafana MELT, source code and alerts, no direct Kubernetes substrate or remediation. Three-provider judge ensemble. Lower is better.. Source: www.pagerduty.com. Saturation forecast: Around August 2028. 2 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5.50.56#3
2Claude Sonnet 50.65#55

No result here: #5 GPT-6 Astra, #7 Gemini 4 Argon, #8 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=pagerduty-sre-claude-code-misdirection · How It Works · Data refreshed daily, snapshot 2026-10-16.