DiningBench - Calorie Estimation: leaderboard

Metric: Mean absolute percentage error (%) of the estimated calories over the 1,650 DiningBench nutrition-estimation dishes (multi-view restaurant photos; ground truth from merchant labels or ingredient-based estimates cross-checked against USDA FoodData Central); lower is better. Source: arxiv.org. Saturation forecast: Around March 2027. 29 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)19.99
2Gemini 3 Flash (Preview)20.57
3GPT-525.14
4O4 Mini27.68
5Gemma 3 12B (IT)27.95
6Gemini 2.5 Pro28.61
7Gemini 2.5 Flash30.21
8Qwen 3 VL 8B Instruct31.06
9Qwen 3 VL 30B A3B (Thinking)32.33
10Qwen 3 VL 30B A3B Instruct32.49
11Qwen 2.5 VL 32B Instruct32.66
12Claude Sonnet 4.535.01
13Qwen 2.5 VL 72B Instruct35.88
14GPT-4.136.88
15Qwen 3 VL 4B Instruct40.37

Interactive version: theaggregate.ai/benchmark?slug=diningbench-calorie-estimation · How It Works · Data refreshed daily, snapshot 2026-10-07.