KernelGenBench-MC (Claude Code) - Iluvatar CoreX: leaderboard

Metric: Clean pass rate (%; share of the 110 PyTorch ATen operators whose generated Triton kernel passes numerical validation on every test case of its combinatorial shape, dtype and layout suite and every anti-hack check, as a drop-in replacement; the Claude Code agent with execution feedback; an Iluvatar CoreX accelerator; 30-minute budget per operator). Source: arxiv.org. Saturation forecast: Around December 2026. 4 models tracked.

Top models

#ModelScore
1Claude Opus 4.683
2MiniMax-M2.569
3GLM-537
4Qwen 3.5 27B23

Interactive version: theaggregate.ai/benchmark?slug=kernelgenbench-mc-claude-code-iluvatar-corex · How It Works · Data refreshed daily, snapshot 2026-09-29.