AgenticInterpBench (HyVE) - Component Tag Accuracy: leaderboard
Circuit-explanation benchmark, component tag: the share of circuit components whose predicted functional tag exactly matches the annotation, in percent, higher is better. 84 semi-synthetic InterpBench transformers with known circuits (163 annotated components); the model is the backbone of the authors' HyVE explainer agent, which observes activations, tests hypotheses with code and explains each component. Subjects are compiled circuits, where scores can partly reflect informed guessing. Khan et al., 2026.
Metric: Tag accuracy (%; exact match per circuit component). Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 | 79 | #158 |
| 2 | Gemini 3.1 Pro (Preview) | 76 | #91 |
| 3 | GPT-5.4 | 74 | #121 |
| 4 | Qwen 3 Coder 30B A3B Instruct | 67 | #973 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=agenticinterpbench-hyve-component-tag-accuracy · How It Works · Data refreshed daily, snapshot 2026-11-12.