HELM Image2Struct - Core Scenarios: leaderboard

Metric: Mean win rate. Source: crfm.stanford.edu. 20 models tracked.

Top models

#ModelScore
1GPT-4o (2024-08-06)94.74
2GPT-4o (2024-05-13)80.7
3Gemini 1.5 Pro (002)78.95
4Claude 3.5 Sonnet (20240620)73.68
5Gemini 1.5 Flash (002)71.05
6GPT-4o Mini (2024-07-18)70.18
7Claude 3 Opus (20240229)62.28
8Claude 3.5 Sonnet (20241022)60.53
9Claude 3 Sonnet (20240229)49.12

Interactive version: theaggregate.ai/benchmark?slug=helm-image2struct-core-scenarios · How It Works · Data refreshed daily, snapshot 2026-09-08.