KernelGenBench-MS (Claude Code) - ATen Operators: leaderboard
KernelGenBench asks models and coding agents to write Triton kernels that drop into PyTorch in place of an existing operator. A kernel counts only when it passes numerical checks across a combinatorial suite of shapes, data types and layouts and clears anti-hack interception that blocks calls back to the reference implementation. This board covers the PyTorch ATen operators on an NVIDIA A100, generated by the Claude Code agent with execution feedback.
Metric: Clean pass rate (%; share of the 110 PyTorch ATen operators whose generated Triton kernel passes numerical validation on every test case of its combinatorial shape, dtype and layout suite and every anti-hack check, as a drop-in replacement; the Claude Code agent with execution feedback; NVIDIA A100; 30-minute budget per operator). Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.6 | 92 | #102 |
| 2 | Qwen 3.5 27B | 80 | #359 |
| 3 | GLM-5 | 72 | #260 |
| 4 | MiniMax-M2.5 | 69 | #582 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=kernelgenbench-ms-claude-code-aten-operators · How It Works · Data refreshed daily, snapshot 2026-11-13.