FeynmanBench: leaderboard

Metric: Score (%), the mean of the five checkpoint pass rates (vertex inventory, propagator inventory, topological connectivity, momentum routing, full amplitude) on FeynmanBench's Feynman-diagram tasks (a rendered diagram plus minimal conventions; Standard Model QED, electroweak and QCD diagrams from tree level to two loops), API models at temperature 0, mean of five runs; four models ran on subsets of 165 to 742 items, the others on about 2,000; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 19 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)44.3
2Gemini 3 Flash40.2
3Qwen 3.6 Plus29.6
4Seed 2.0 Pro28.6
5Claude Sonnet 4.628.5
6Qwen 3.5 Plus27.7
7GLM-5V Turbo21.3
8GPT-5.112.4
9GPT-5.412
10Claude Opus 4.712
11GPT-5.211.1
12Claude Opus 4.610.7
13Claude Opus 4.510.5
14Kimi K2.53.2
15Claude Sonnet 4.52

Interactive version: theaggregate.ai/benchmark?slug=feynmanbench · How It Works · Data refreshed daily, snapshot 2026-10-07.