DiningBench - Carbohydrate Estimation: leaderboard

Metric: Mean absolute percentage error (%) of the estimated carbohydrates over the 1,650 DiningBench nutrition-estimation dishes (multi-view restaurant photos; ground truth from merchant labels or ingredient-based estimates cross-checked against USDA FoodData Central); lower is better. Source: arxiv.org. Saturation forecast: Around February 2027. 29 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)27.4
2Gemini 3 Flash (Preview)27.94
3GPT-4.135.81
4GPT-536.63
5O4 Mini37.38
6GPT-4o40.19
7Qwen 3 VL 30B A3B Instruct41.53
8Qwen 2.5 VL 72B Instruct41.7
9Gemini 2.5 Flash42.62
10Gemini 2.5 Pro43.01
11Qwen 2.5 VL 32B Instruct43.92
12Qwen 3 VL 8B Instruct43.99
13GPT-4o Mini45.03
14Qwen 3 VL 30B A3B (Thinking)48.12
15Qwen 3 VL 4B Instruct49.28

Interactive version: theaggregate.ai/benchmark?slug=diningbench-carbohydrate-estimation · How It Works · Data refreshed daily, snapshot 2026-10-07.