METR Q4 2026 TH2 - AZsPCs Primorial Soup (Human Percentile): leaderboard

METR's Q4 2026 capability update (20 November 2026): where a model's best 48-hour run on the past Al Zimmermann's Programming Contest "Primorial Soup" ranks among that contest's 311 human entrants, who had about three months. 100 means beating every human entrant. One of the 15 contests in the TH2 suite.

Metric: Percentile Among Human Participants. Source: metr.org. Saturation forecast: Around February 2027. 10 models tracked. Updated 21 Nov 2026.

Top models

#ModelScoreOverall rank
1GPT-6 Astra89.39#10
2Claude Fable 5.188.1#20
3GPT-5.6 Sol84.89#37
4Claude Opus 5.577.17#9
5GPT-6 Luna67.2#105
6Claude Haiku 5.558.52#75
7GPT-5.457.56#135
8Claude Opus 4.756.27#85
9Claude Opus 4.554.02#160
10GPT-516.4#178

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=metr-q4-2026-th2-azspcs-primorial-soup-human-percentile · How It Works · Data refreshed daily, snapshot 2026-11-21.