SeePhys Pro: leaderboard

We introduce SeePhys Pro, a fine-grained modality transfer benchmark that studies whether models preserve the same reasoning capability when critical information is progressively transferred from text to image. Unlike standard vision-essential benchmarks that evaluate a single input form, SeePhys Pro features four semantically aligned variants for each problem with progressively increasing visual

Metric: Cons4 (self-reported). Source: benchmarklist.com. Saturation forecast: Around August 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)47#58
2Gemini 3 Pro43#80
3Claude Opus 4.733.5#49
4GPT-5.432.6#79
5Qwen 3.6 Flash29.9#214
6Kimi K2.526#144
7Qwen 3.5 122B A10B25.5#173
8Claude Opus 4.619#63
9Qwen 3.5 9B12.8#379
10Qwen 3.5 27B9.9#187
11Gemma 4 26B A4B (IT)9#297
12GPT-58.9#98
13Gemma 4 31B (IT)8.9#176

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=seephys-pro · How It Works · Data refreshed daily, snapshot 2026-10-20.