BAGEL - Wikipedia Diet: leaderboard

Metric: Accuracy (%, times 100) on the 296 Wikipedia diet questions of BAGEL, closed-book four-option single-answer multiple choice (the source passage is withheld), one unified prompt, greedy decoding with seed 0, a single run per model; questions written by GPT-4o-mini from Wikipedia species articles, GloBI interaction records, bioRxiv preprints and Xeno-canto recordings, options shuffled; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 13 models tracked.

Top models

#ModelScore
1Claude Opus 4.693.9
2GPT-5.491.2
3Gemma 3 27B (IT)89.5
4Qwen 3 32B (Non-reasoning)86.5
5Phi-484.5
6Qwen 3 14B (Non-reasoning)84.5
7Qwen 3 8B (Non-reasoning)83.8
8Llama 3.1 8B Instruct77.7
9Mistral 7B Instruct (v0.3)73.6
10Qwen 3 4B (Non-reasoning)72
11gemma-7B69.3
12Qwen 3 0.6B (Non-reasoning)23.6

Interactive version: theaggregate.ai/benchmark?slug=bagel-wikipedia-diet · How It Works · Data refreshed daily, snapshot 2026-10-07.