BloomBench - Arabic - Evaluate: leaderboard

Metric: Accuracy (%) on the 592 Arabic BloomBench items at the Bloom level Evaluate (judging coherence, harm and safety, and image quality), four-option image-question multiple choice, zero-shot, temperature 0, the chosen letter parsed from the generated answer (Regex-based Answer Extraction; unparseable answers count as wrong); chance 25; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScore
1Gemma 4 31B93
2Gemma 3 27B89
3Gemma 4 26B A4B89
4Gemma 3 12B88
5GPT-4o Mini83
6Qwen 2.5 VL 7B82
7Qwen 2 VL 7B79
8Gemma 3 4B73

Interactive version: theaggregate.ai/benchmark?slug=bloombench-arabic-evaluate · How It Works · Data refreshed daily, snapshot 2026-09-29.