FeynmanBench - Topological Connectivity: leaderboard

Metric: CP3 pass rate (%), a vertex connection graph isomorphic to the diagram, judged by a three-model LLM panel by majority vote, on FeynmanBench's Feynman-diagram tasks (a rendered diagram plus minimal conventions; Standard Model QED, electroweak and QCD diagrams from tree level to two loops), API models at temperature 0, mean of five runs; four models ran on subsets of 165 to 742 items, the others on about 2,000; higher is better. Source: arxiv.org. Saturation forecast: Around April 2028. 19 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)33.6
2Claude Sonnet 4.619.2
3Gemini 3 Flash16.8
4Qwen 3.5 Plus15.9
5Qwen 3.6 Plus15.2
6Seed 2.0 Pro13.3
7GLM-5V Turbo10.5
8Claude Opus 4.75.9
9Claude Opus 4.65.7
10Claude Opus 4.53.5
11GPT-5.23.3
12GPT-5.13.1
13GPT-5.43
14Kimi K2.51.4
15Claude Sonnet 4.51.1

Interactive version: theaggregate.ai/benchmark?slug=feynmanbench-topological-connectivity · How It Works · Data refreshed daily, snapshot 2026-10-07.