FeynmanBench - Momentum Routing: leaderboard

FeynmanBench (2026) gives a multimodal model a machine-generated Feynman diagram (Standard Model QED, electroweak or QCD, tree level to two loops) with minimal labelling conventions and asks it to recover the full physical content of the diagram. Checkpoint 4: an internal momentum assignment that conserves momentum at every vertex, judged by a three-model LLM panel; pass rate in percent, higher is better.

Metric: CP4 pass rate (%), a self-consistent internal momentum assignment conserving momentum at every vertex, judged by a three-model LLM panel, on FeynmanBench's Feynman-diagram tasks (a rendered diagram plus minimal conventions; Standard Model QED, electroweak and QCD diagrams from tree level to two loops), API models at temperature 0, mean of five runs; four models ran on subsets of 165 to 742 items, the others on about 2,000; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 17 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)23.9#102
2Claude Sonnet 4.612.6#179
3Qwen 3.6 Plus9.7#245
4Qwen 3.5 Plus9.4#250
5GLM-5V Turbo7#365
6Seed 2.0 Pro5.4#226
7Gemini 3 Flash5#180
8Claude Opus 4.74.7#86
9Claude Opus 4.64.5#114
10GPT-5.42.1#138
11GPT-5.11.3#248
12GPT-5.20.9#190
13Claude Opus 4.50.9#165
14Claude Sonnet 4.50.6#267
15Qwen 3.6 Max0.5#192

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=feynmanbench-momentum-routing · How It Works · Data refreshed daily, snapshot 2026-11-22.