SalesLLM - English (CustomerLM User): leaderboard
English single-product sales dialogues on SalesLLM (2026), financial services and consumer goods scenarios at five difficulty tiers, where the model sells to CustomerLM, the Qwen3-8B customer model of the authors, simulating the customer for up to 20 rounds. The score from 1 to 10 averages the buying intent of the customer at the end of the dialogue, read by a fine-tuned classifier, with an LLM-judge rubric score for deal progression; higher is better.
Metric: SalesLLM benchmark score (1-10): 0.5 x buying-intent score (end-of-dialogue customer intent from a fine-tuned BERT classifier, five levels mapped to 2, 4, 6, 8, 10) + 0.5 x selling-performance score (0-10 LLM-judge rubric on verbal purchase commitment, concrete next steps, key-information elicitation and objection resolution, credited only on customer-side evidence), on the curated SalesLLM single-product scenarios (Financial Services and Consumer Goods, five difficulty tiers) in English, with CustomerLM (the authors' Qwen3-8B customer model trained with SFT and DPO on crowdworker sales conversations) as the simulated customer; the model acts as the salesperson for at most 20 rounds at temperature 0.8; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 15 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Gemini 3 Flash | 6.03 | #175 | |
| 2 | Gemini 3 Pro | 6.03 | #145 | |
| 3 | MiMo-V2-Flash | 5.9 | #684 | |
| 4 | GPT-5 Nano | 5.84 | #906 | |
| 5 | DeepSeek V3.1 | Non-reasoning | 5.8 | #511 |
| 6 | Qwen 3 8B | 5.79 | #1873 | |
| 7 | Qwen 2.5 72B | 5.63 | #1188 | |
| 8 | Qwen 3 32B | 5.62 | #972 | |
| 9 | Qwen 3 Max | 5.56 | #415 | |
| 10 | glm-4-9B | 5.55 | #2738 | |
| 11 | Doubao-1.5-Pro-32k | 5.48 | #694 | |
| 12 | GLM-4.6 | 5.32 | #498 | |
| 13 | Llama 3.3 70B | 5.24 | #1514 | |
| 14 | GPT-4o | 5.19 | #751 | |
| 15 | Gemma 3 27B | 5.09 | #1663 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=salesllm-english-customerlm-user · How It Works · Data refreshed daily, snapshot 2026-11-21.