SCDBench: leaderboard
SCDBench (Qin, Song and Gervais, 2026) tests LLM decompilation of 600 verified Ethereum smart contracts in three difficulty tiers: from EVM assembly and function-selector hints the model must write Solidity that compiles and behaves like the original. Percentage of the 14,553 public functions whose replayed test cases all match the original contract (return data, reverts, logs and storage), zero-shot; higher is better.
Metric: Semantically consistent public functions (%; all replayed test cases match return data, revert status, logs and storage, of 14,553 functions in 600 contracts, zero-shot). Source: arxiv.org. Saturation forecast: Around March 2028. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.7 (High) | 22.48 | #75 (Claude Opus 4.7) |
| 2 | GPT-5.3 Codex (High) | 19.59 | #114 (GPT-5.3 Codex) |
| 3 | GLM-5 (Thinking) | 9.91 | #256 (GLM-5) |
| 4 | GLM-5 (Non-reasoning) | 5.77 | #256 (GLM-5) |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=scdbench · How It Works · Data refreshed daily, snapshot 2026-11-12.