Market-Bench - Bid Efficiency: leaderboard

Metric: Bid efficiency (won share of bid quantity times base value of won goods over the amount paid; 0 or more); all 20 models compete as retailer agents in one simulated supply-chain market (sealed-bid procurement auctions, retail pricing and slogans; 6 steps, temperature 0), mean over 10 runs; higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 20 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash0.8
2Gemini 2.5 Pro0.79
3O30.7
4GPT-4o0.45
5ERNIE 4.5 300B A47B0.42
6Claude Sonnet 4.50.41
7Phi-40.39
8Qwen 2.5 VL 72B Instruct0.32
9InternLM3-8B-Instruct0.28
10DeepSeek V3.20.24
11Qwen 2.5 VL 32B Instruct0.2

Interactive version: theaggregate.ai/benchmark?slug=market-bench-bid-efficiency · How It Works · Data refreshed daily, snapshot 2026-10-07.