HELM VHELM - A Okvqa Spanish: leaderboard

Metric: PEM (Translate). Source: crfm.stanford.edu. 48 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro (Preview 03-25)90.4
2GPT-4.587.4
3O3 (2025-04-16)87.2
4Gemini 2.0 Flash (Preview)86
5Gemini 2.0 Pro (Preview 02-05)85.9
6O4 Mini (2025-04-16)85.8
7GPT-4o (2024-05-13)85.5
8Gemini 2.0 Flash85.3
9GPT-4.1 (2025-04-14)85
10GPT-4o (2024-08-06)84.6
11GPT-4o (2024-11-20)84
12GPT-4.1 Mini83.8
13Gemini 1.5 Pro (002)83.5
14Gemini 2.0 Flash Lite83.2
15Gemini 2.0 Flash Lite (Preview 02-05)82.9

Interactive version: theaggregate.ai/benchmark?slug=helm-vhelm-a-okvqa-spanish · How It Works · Data refreshed daily, snapshot 2026-09-08.