BigEarthNet.txt - Binary VQA: leaderboard

Metric: Accuracy (%) on the 6,927 balanced yes/no questions (land-cover presence, area, count and adjacency) of the BigEarthNet.txt benchmark split (1,082 manually verified Sentinel-1/Sentinel-2 image pairs over Europe from the BigEarthNet v2.0 test set), zero-shot, each model given the RGB bands of the Sentinel-2 image with the benchmark instruction and answers extracted even when off-format; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.260.39#105

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=bigearthnet-txt-binary-vqa · How It Works · Data refreshed daily, snapshot 2026-10-11.