DiningBench - Fat Estimation: leaderboard

Metric: Mean absolute percentage error (%) of the estimated fat over the 1,650 DiningBench nutrition-estimation dishes (multi-view restaurant photos; ground truth from merchant labels or ingredient-based estimates cross-checked against USDA FoodData Central); lower is better. Source: arxiv.org. Saturation forecast: Around March 2027. 29 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)26.53
2Gemini 3 Flash (Preview)27.09
3GPT-533.49
4O4 Mini37.8
5Gemma 3 12B (IT)41.12
6Gemini 2.5 Pro42.19
7Qwen 3 VL 30B A3B Instruct43.37
8Qwen 3 VL 30B A3B (Thinking)43.66
9Qwen 3 VL 4B Instruct44.55
10Gemini 2.5 Flash44.56
11Qwen 3 VL 8B Instruct48.02
12GPT-4.149.29
13Qwen 2.5 VL 32B Instruct50.05
14Claude Sonnet 4.550.82
15Qwen 2.5 VL 72B Instruct51.27

Interactive version: theaggregate.ai/benchmark?slug=diningbench-fat-estimation · How It Works · Data refreshed daily, snapshot 2026-10-07.