SCDBench - ABI Recovery: leaderboard
Metric: ABI recovery F1 (%; micro F1 of the recovered public function signatures against the ground-truth ABI over all 600 contracts, extra functions counting as false positives and missing ones as false negatives, printed as a fraction and scaled to percent; zero-shot). Source: arxiv.org. Saturation forecast: Around December 2026. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.3 Codex (High) | 76.6 |
| 2 | Claude Opus 4.7 (High) | 61.5 |
| 3 | GLM-5 (Thinking) | 42.8 |
| 4 | GLM-5 (Non-reasoning) | 28.7 |
Interactive version: theaggregate.ai/benchmark?slug=scdbench-abi-recovery · How It Works · Data refreshed daily, snapshot 2026-09-29.