Skip to content

The Aggregate

Unified LLM rankings, daily
Models What's New Trends Benchmarks Skill Maps
How It Works Guesswork Metrics
The Aggregate
Loading data...

Big Code Memorization — leaderboard

Code-generation evaluation from the Memorization or Generation of Big Code Models study, comparing HumanEval solutions with transformed HumanEval-ET variants that stress generalization.

Source: huggingface.co.

Interactive version: theaggregate.ai/benchmark?slug=big-code-memorization · How the rankings work · Data refreshed daily, snapshot 2026-07-22.

Built by Mikhail Doroshenko — AI researcher, co-author of Humanity’s Last Exam. Independent project; no affiliation with any AI lab.