ALPBench - Badminton Rackets (Profile F1): leaderboard

Metric: Profile-level F1 (%): the harmonic mean of the shares of predicted and of ground-truth attribute combinations that match exactly (every attribute right), for the next purchased badminton rackets item's attribute combination (price range, brand, material and level), predicted zero-shot from 100 users' one-year Kuaishou e-commerce interaction histories (clicks, add-to-cart and purchases with titles, selling points and price tiers, up to about 340K tokens); ground truth from verified purchases after a shopping festival cut-off; higher is better. Source: arxiv.org. Saturation forecast: Not forecast. 15 models tracked.

Top models

#ModelScoreOverall rank
1Seed 1.825.5#136
2Qwen 3 Max (Preview)23.67#224
3MiniMax-M222.07#307
4Gemini 2.5 Flash21.56#237
5Qwen 3 30B A3B 2507 (Thinking)21#366 (Qwen 3 30B A3B 2507)
6Gemini 2.5 Pro19.3#145
7GLM-4.619.2#246
8Claude Sonnet 4.519.03#138
9MiniMax-M2.118.77#283
10GPT-5.2 Instant17.8#205
11DeepSeek V3.217.73#198
12GLM-4.517.23#265
13DeepSeek R116.67#245
14Qwen 3 235B A22B 2507 Instruct15.8#291
15Kimi K215.33#236

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=alpbench-badminton-rackets-profile-f1 · How It Works · Data refreshed daily, snapshot 2026-10-11.