ASI-Bench (Claude Code) - B2 Method Hints: leaderboard
ASI-Bench prompt band B2 (method hints) on 60 project-level tasks without external tool access (arXiv 2608.17271v1). Scientific Score macro-averaged over tasks and rounds, 0-100, higher is better. Claude Code harness runs only, from the Apexintelligence-AI/ASI-Bench-Leaderboard Space's app/page.tsx; efforts stay in the label.
Metric: Scientific Score (0-100). Source: huggingface.co. Saturation forecast: Around November 2028. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 (Max) | 45.8 | #16 (Claude Opus 5) |
| 2 | Gemini 3.8 Flash | 39.13 | #30 |
| 3 | Claude Opus 4.8 (Max) | 36.25 | #39 (Claude Opus 4.8) |
| 4 | GLM-5.3 (Max) | 35.45 | #44 (GLM-5.3) |
| 5 | Kimi K3 (Max) | 35.24 | #35 (Kimi K3) |
| 6 | Qwen 3.8 Max (Max) | 32.51 | #34 (Qwen 3.8 Max) |
| 7 | GLM-5.2 (Max) | 30.81 | #80 (GLM-5.2) |
| 8 | GLM-5.3 Flash (Max) | 28.66 | #77 (GLM-5.3 Flash) |
| 9 | DeepSeek V4 Flash (Max) | 26.49 | #155 (DeepSeek V4 Flash) |
| 10 | DeepSeek V4 Pro (Max) | 18.79 | #112 (DeepSeek V4 Pro) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=asi-bench-claude-code-b2-method-hints · How It Works · Data refreshed daily, snapshot 2026-11-05.