OmniEarth - Semantic Consistency: leaderboard

Metric: Top-1 accuracy (%) on the Semantic Consistency (SEC) task of OmniEarth, zero-shot with each model's default inference settings; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o73.2#333
2Gemini 2.0 Flash63.8#331
3Qwen 2.5 VL 72B Instruct46.3#364
4InternVL3-8B39.1#606
5GLM-4.6V18.1#309

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=omniearth-semantic-consistency · How It Works · Data refreshed daily, snapshot 2026-10-11.