METR Q4 2026 TH2 - Budget NanoGPT (16h): leaderboard
METR's Q4 2026 capability update (20 November 2026): mean score from 0 to 1 on one task of TH2, METR's new long-task suite. The NanoGPT speedrun task (make a language-model training script faster, starting from record #78) in the variant METR's data labels 16h. Higher is better.
Metric: Mean Score (0-1). Source: metr.org. Saturation forecast: Around October 2028. 15 models tracked. Updated 21 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 0.102 | #26 |
| 2 | Claude Opus 5.5 | 0.0666 | #9 |
| 3 | Claude Fable 5.1 | 0.0633 | #20 |
| 4 | Claude Fable 5 | 0.0448 | #33 |
| 5 | GPT-6 Astra | 0.0419 | #10 |
| 6 | GPT-5.6 Sol | 0.0126 | #37 |
| 7 | GPT-5.5 | 0.01 | #54 |
| 8 | Claude Opus 4.7 | 0.0046 | #85 |
| 9 | Claude Opus 4.6 | 0.0034 | #113 |
| 10 | Claude Opus 4.5 | 0.0033 | #160 |
| 11 | Claude Opus 4.8 | 0.0009 | #65 |
| 12 | GPT-4o | 0 | #751 |
| 13 | GPT-5 | 0 | #178 |
| 14 | GPT-5.4 | 0 | #135 |
| 15 | O1 | 0 | #403 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=metr-q4-2026-th2-budget-nanogpt-16h · How It Works · Data refreshed daily, snapshot 2026-11-21.