Chiikabench - Reported Attempted Subset (227): leaderboard
Chiikabench smart-contract challenge suite spanning five chains. Recon/orchestrator/builder/verifier agent team; solved when extraction event meets per-challenge capture floor. The source publishes no token or effort budget. Oracle is a reference, not an evaluated model. DeepSeek reported attempted-subset denominator excludes 23 rejections and remains separate from the full250challenge cohort. Reported Attempted Subset (227). Metric: Pass rate (%).
Metric: Pass rate (%). Source: huggingface.co. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | deepseek-v4.1-flash-1017 | 15.9 |
Interactive version: theaggregate.ai/benchmark?slug=chiikabench-reported-attempted-subset-227 · How It Works · Data refreshed daily, snapshot 2026-10-27.