METR Q4 2026 TH2 - Judge Run (Older Models' Tasks): leaderboard
METR's Q4 2026 capability update (20 November 2026): mean score from 0 to 1 on one task of TH2, METR's new long-task suite. The agent grades another agent's attempt at building an evaluation task, using a rubric, and is scored on agreement with METR's human grader. This half uses tasks built by models released before 9 June 2026. Higher is better.
Metric: Mean Score (0-1). Source: metr.org. Saturation forecast: Around February 2027. 15 models tracked. Updated 21 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5.5 | 0.8236 | #9 |
| 2 | Claude Fable 5.1 | 0.7327 | #20 |
| 3 | GPT-6 Astra | 0.6694 | #10 |
| 4 | Claude Opus 5 | 0.6283 | #26 |
| 5 | Claude Opus 4.7 | 0.6186 | #85 |
| 6 | GPT-5.6 Sol | 0.5953 | #37 |
| 7 | Claude Opus 4.8 | 0.5679 | #65 |
| 8 | GPT-5.4 | 0.5068 | #135 |
| 9 | Claude Fable 5 | 0.5031 | #33 |
| 10 | Claude Opus 4.6 | 0.4997 | #113 |
| 11 | GPT-5.5 | 0.4549 | #54 |
| 12 | Claude Opus 4.5 | 0.4162 | #160 |
| 13 | GPT-5 | 0.2544 | #178 |
| 14 | O1 | 0.1716 | #403 |
| 15 | GPT-4o | 0.0308 | #751 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=metr-q4-2026-th2-judge-run-older-models-tasks · How It Works · Data refreshed daily, snapshot 2026-11-21.