METR Q4 2026 TH2 - Budget NanoGPT: leaderboard
METR's Q4 2026 capability update (20 November 2026): mean score from 0 to 1 on one task of TH2, METR's new long-task suite. The agent speeds up a NanoGPT speedrun training script starting from record #78, with 48 hours on eight H100 GPUs; the score rises with the training time cut. Higher is better.
Metric: Mean Score (0-1). Source: metr.org. Saturation forecast: Around May 2028. 15 models tracked. Updated 21 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra | 0.1267 | #10 |
| 2 | Claude Fable 5.1 | 0.0824 | #20 |
| 3 | Claude Opus 5.5 | 0.0821 | #9 |
| 4 | Claude Opus 5 | 0.0552 | #26 |
| 5 | Claude Fable 5 | 0.0167 | #33 |
| 6 | Claude Opus 4.5 | 0.0121 | #160 |
| 7 | GPT-5.6 Sol | 0.0115 | #37 |
| 8 | Claude Opus 4.6 | 0.0091 | #113 |
| 9 | Claude Opus 4.7 | 0.0056 | #85 |
| 10 | Claude Opus 4.8 | 0.0043 | #65 |
| 11 | GPT-5.5 | 0.0042 | #54 |
| 12 | GPT-4o | 0 | #751 |
| 13 | GPT-5 | 0 | #178 |
| 14 | GPT-5.4 | 0 | #135 |
| 15 | O1 | 0 | #403 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=metr-q4-2026-th2-budget-nanogpt · How It Works · Data refreshed daily, snapshot 2026-11-21.