HELM VHELM - Exams V - Bulgarian (Natural Science): leaderboard

VHELM (Stanford CRFM HELM for vision-language models, run v2.1.2) Exams-V questions in Bulgarian on natural science: school exam multiple-choice questions rendered as images that combine text, formulas and figures; 54 questions, prefix quasi-exact match. Percent correct, 0-100, higher is better.

Metric: Prefix Quasi-Exact Match (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 48 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4.1 (2025-04-14)46.3#257
2GPT-4.540.74#278
3GPT-4.1 Mini33.33#363
4GPT-4o (2024-08-06)33.33#343
5Gemini 2.5 Pro (Preview 03-25)31.48#126
6Llama 4 Maverick Instruct FP822.22#424
7GPT-4o (2024-05-13)20.37#337
8Claude 3.5 Sonnet (20241022)14.81#302
9Gemini 2.0 Flash12.96#351
10Gemini 1.5 Pro (002)11.11#368
11Claude 3.5 Sonnet (20240620)11.11#308
12GPT-4o (2024-11-20)9.26#392
13Gemini 2.0 Flash (Preview)7.41#376
14Gemini 2.0 Pro (Preview 02-05)5.56#318
15Claude 3 Opus (20240229)3.7#428

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-vhelm-exams-v-bulgarian-natural-science · How It Works · Data refreshed daily, snapshot 2026-11-05.