TelemetrySuffBench - Fault-Type Classification: leaderboard
Metric: Fault-type macro-F1 (%; two-class taxonomy of wrong-reference-binding vs stale-reference-state; over TelemetrySuffBench's 216 delayed-binding fault traces; full-telemetry view; closed candidate sets, invalid outputs scored zero). Source: arxiv.org. Saturation forecast: Around December 2026. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.5 | 79.9 |
| 2 | Claude Opus 5 | 77.7 |
| 3 | GPT-5.6 Sol | 76 |
| 4 | DeepSeek V4 Pro | 55.3 |
| 5 | Qwen 3.7 Max | 39.8 |
Interactive version: theaggregate.ai/benchmark?slug=telemetrysuffbench-fault-type-classification · How It Works · Data refreshed daily, snapshot 2026-09-26.