SalesLLM - Chinese (CustomerLM User): leaderboard

Metric: SalesLLM benchmark score (1-10): 0.5 x buying-intent score (end-of-dialogue customer intent from a fine-tuned BERT classifier, five levels mapped to 2, 4, 6, 8, 10) + 0.5 x selling-performance score (0-10 LLM-judge rubric on verbal purchase commitment, concrete next steps, key-information elicitation and objection resolution, credited only on customer-side evidence), on the curated SalesLLM single-product scenarios (Financial Services and Consumer Goods, five difficulty tiers) in Chinese, with CustomerLM (the authors' Qwen3-8B customer model trained with SFT and DPO on crowdworker sales conversations) as the simulated customer; the model acts as the salesperson for at most 20 rounds at temperature 0.8; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 15 models tracked.

Top models

Interactive version: theaggregate.ai/benchmark?slug=salesllm-chinese-customerlm-user · How It Works · Data refreshed daily, snapshot 2026-10-07.