KnotBench - Same Canonical PD (PD Codes): leaderboard
Metric: Accuracy (%) on the 100 A3-S items: whether two PD codes are the same canonical code; zero-shot with a forced ANSWER line and strict matching, 64K output-token budget, random baseline 50%; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5 (Thinking) | 99 |
| 2 | Claude Opus 4.7 | 50 |
| 3 | Claude Opus 4.7 (Thinking) | 50 |
Interactive version: theaggregate.ai/benchmark?slug=knotbench-same-canonical-pd-pd-codes · How It Works · Data refreshed daily, snapshot 2026-10-07.