PagerDuty SRE (Claude Code) - Explanation Quality: leaderboard
Explanation Quality (0-1), Claude Code fixed-harness cohort; 17 injected Kubernetes financial-app fault scenarios, one trial per agent, default config except model; same Grafana MELT, source code and alerts, no direct Kubernetes substrate or remediation. Three-provider judge ensemble. Higher is better.
Metric: Explanation Quality (0-1), Claude Code fixed-harness cohort; 17 injected Kubernetes financial-app fault scenarios, one trial per agent, default config except model; same Grafana MELT, source code and alerts, no direct Kubernetes substrate or remediation. Three-provider judge ensemble. Higher is better.. Source: www.pagerduty.com. Saturation forecast: Around January 2027. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 5 | 0.9 | #55 |
| 2 | Claude Opus 5.5 | 0.9 | #3 |
No result here: #5 GPT-6 Astra, #7 Gemini 4 Argon, #8 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=pagerduty-sre-claude-code-explanation-quality · How It Works · Data refreshed daily, snapshot 2026-10-16.