FeynmanBench: leaderboard
FeynmanBench (2026) gives a multimodal model a machine-generated Feynman diagram (Standard Model QED, electroweak or QCD, tree level to two loops) with minimal labelling conventions and asks it to recover the full physical content of the diagram. Score is the mean of the five checkpoint pass rates, from vertex inventory to the full amplitude, in percent; higher is better.
Metric: Score (%), the mean of the five checkpoint pass rates (vertex inventory, propagator inventory, topological connectivity, momentum routing, full amplitude) on FeynmanBench's Feynman-diagram tasks (a rendered diagram plus minimal conventions; Standard Model QED, electroweak and QCD diagrams from tree level to two loops), API models at temperature 0, mean of five runs; four models ran on subsets of 165 to 742 items, the others on about 2,000; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 17 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Pro (Preview) | 44.3 | #99 |
| 2 | Gemini 3 Flash | 40.2 | #175 |
| 3 | Qwen 3.6 Plus | 29.6 | #238 |
| 4 | Seed 2.0 Pro | 28.6 | #222 |
| 5 | Claude Sonnet 4.6 | 28.5 | #173 |
| 6 | Qwen 3.5 Plus | 27.7 | #242 |
| 7 | GLM-5V Turbo | 21.3 | #360 |
| 8 | GPT-5.1 | 12.4 | #240 |
| 9 | GPT-5.4 | 12 | #135 |
| 10 | Claude Opus 4.7 | 12 | #85 |
| 11 | GPT-5.2 | 11.1 | #185 |
| 12 | Claude Opus 4.6 | 10.7 | #113 |
| 13 | Claude Opus 4.5 | 10.5 | #160 |
| 14 | Kimi K2.5 | 3.2 | #266 |
| 15 | Qwen 3 VL Plus | 2.9 | #512 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=feynmanbench · How It Works · Data refreshed daily, snapshot 2026-11-21.