BloomBench - English - Understand: leaderboard

Metric: Accuracy (%) on the 1592 English BloomBench items at the Bloom level Understand (compositional and cognitive understanding: relations, emotions, semantics), four-option image-question multiple choice, zero-shot, temperature 0, the chosen letter parsed from the generated answer (Regex-based Answer Extraction; unparseable answers count as wrong); chance 25; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScore
1Gemma 3 27B94
2Gemma 3 12B94
3Qwen 2.5 VL 7B94
4Qwen 2 VL 7B93
5Gemma 4 31B93
6Gemma 4 26B A4B91
7GPT-4o Mini90
8Gemma 3 4B89

Interactive version: theaggregate.ai/benchmark?slug=bloombench-english-understand · How It Works · Data refreshed daily, snapshot 2026-09-29.