ALPBench - Shoes (Attribute F1): leaderboard
Metric: Attribute-level F1 (%): the F1 of each target attribute computed over all instances, averaged over the category's attributes, for the next purchased shoes item's attribute combination (price range, category, closure type and toe style), predicted zero-shot from 100 users' one-year Kuaishou e-commerce interaction histories (clicks, add-to-cart and purchases with titles, selling points and price tiers, up to about 340K tokens); ground truth from verified purchases after a shopping festival cut-off; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 15 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 42.64 | #145 |
| 2 | Seed 1.8 | 39.81 | #136 |
| 3 | GPT-5.2 Instant | 39.58 | #205 |
| 4 | Qwen 3 Max (Preview) | 39.36 | #224 |
| 5 | MiniMax-M2.1 | 38.66 | #283 |
| 6 | Gemini 2.5 Flash | 33.99 | #237 |
| 7 | Claude Sonnet 4.5 | 32.74 | #138 |
| 8 | GLM-4.6 | 31.97 | #246 |
| 9 | MiniMax-M2 | 31.73 | #307 |
| 10 | GLM-4.5 | 30.21 | #265 |
| 11 | Qwen 3 235B A22B 2507 Instruct | 25.32 | #291 |
| 12 | DeepSeek V3.2 | 24.51 | #198 |
| 13 | Qwen 3 30B A3B 2507 (Thinking) | 24.33 | #366 (Qwen 3 30B A3B 2507) |
| 14 | DeepSeek R1 | 20.89 | #245 |
| 15 | Kimi K2 | 12.37 | #236 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=alpbench-shoes-attribute-f1 · How It Works · Data refreshed daily, snapshot 2026-10-11.