HELM VHELM - Exams V - Spanish (Natural Science): leaderboard

VHELM (Stanford CRFM HELM for vision-language models, run v2.1.2) Exams-V questions in Spanish on natural science: school exam multiple-choice questions rendered as images that combine text, formulas and figures; 26 questions, prefix quasi-exact match. Percent correct, 0-100, higher is better.

Metric: Prefix Quasi-Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 48 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro (Preview 03-25)92.31#126
2O3 (2025-04-16)92.31#125
3O4 Mini (2025-04-16)88.46#183
4O1 (2024-12-17)88.46#157
5Gemini 2.0 Flash84.62#351
6GPT-4 Turbo84.62#417
7GPT-4o (2024-11-20)80.77#392
8Gemini 2.0 Flash (Preview)76.92#376
9Gemini 2.0 Pro (Preview 02-05)76.92#318
10GPT-4.573.08#278
11Gemini 1.5 Pro (002)69.23#368
12GPT-4o (2024-05-13)69.23#337
13Gemini 2.0 Flash Lite69.23#455
14GPT-4.1 (2025-04-14)65.38#257
15GPT-4o (2024-08-06)65.38#343

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-vhelm-exams-v-spanish-natural-science · How It Works · Data refreshed daily, snapshot 2026-11-05.