PolyReal - Raw Data Extraction: leaderboard

PolyReal (2026) evaluates multimodal models on 545 expert-written polymer science tasks covering five stages of real experimental work. Answers are scored against expert key points by an LLM judge and summarized as F1 from 0 to 1. This board is F1 on the module about reading NMR and IR spectra, charts and raw instrument data files; higher is better.

Metric: F1 score on the Raw Data Extraction and Analysis module of PolyReal (parsing NMR, IR spectra and raw data files); higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 15 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 2.5 Flash0.436#463
2GPT-50.426#178
3O30.422#237
4Gemini 2.5 Pro0.408#276
5Qwen 3 VL 32B (Thinking)0.39#573
6Claude Sonnet 4.5Thinking0.356#261
7Qwen 3 VL 235B A22B (Thinking)0.355#459
8Gemini 2.0 Flash (Thinking)0.332
9DeepSeek R10.329#482
10GPT-4o0.323#751
11Intern-S10.304#624
12Grok 40.3#319
13Qwen 2.5 VL 72B Instruct0.245#841
14GPT-4o Mini0.211#1667
15DeepSeek-VL20.138#2927

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=polyreal-raw-data-extraction · How It Works · Data refreshed daily, snapshot 2026-11-21.