DiscoverPhysics - Pass@1: leaderboard
DiscoverPhysics (2026) asks an LLM agent to discover the laws of motion of 22 simulated worlds whose physics deviates from our own by designing experiments, then to submit an explanation and a Python implementation of the law. A world passes when the law predicts held-out trajectories within a normalized MSE of 0.1 and the explanation scores at least 0.9 against an expert rubric; this board is the expected percent of worlds passed in one attempt, higher is better.
Metric: Expected share of the 22 worlds (%) passed in one attempt, estimated from five seeds per world: a world passes when the submitted law predicts held-out test particles with a variance-normalized trajectory MSE below 0.1 and the explanation scores at least 0.9 against the expert rubric (claude-opus-4-6 judge); higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Claude Opus 4.7 | High | 26.4 | #85 |
| 2 | GPT-5.5 | Medium | 21.7 | #54 |
| 3 | Qwen 3.5 397B A17B | 4.5 | #264 | |
| 4 | Kimi K2.5 | 2.6 | #266 | |
| 5 | Claude Sonnet 4.6 | 1.8 | #173 | |
| 6 | Qwen 3 235B A22B | 1 | #628 | |
| 7 | GPT-5.4 | 0.9 | #135 | |
| 8 | Llama 3.3 70B Instruct | 0 | #1385 | |
| 9 | GPT-OSS-120B | 0 | #704 | |
| 10 | Claude Haiku 4.5 | 0 | #583 | |
| 11 | GPT-OSS-20B | 0 | #1183 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=discoverphysics-pass-1 · How It Works · Data refreshed daily, snapshot 2026-11-21.