HPR-Bench - Profile Summarization - Tag Coverage: leaderboard

Metric: Extracted-Tag Coverage (%; COVEx, share of profile tags recovered from the summary). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScore
1Qwen 3 235B A22B 2507 (Thinking)96.38
2Qwen 3 235B A22B 2507 Instruct94.71
3GLM-5 (Thinking)94.22
4DeepSeek V3.2 (Thinking)93.41
5Kimi K2.5 (Thinking)93.32
6DeepSeek R1 052892.21
7Qwen 3.6 Plus (Thinking)90.46
8Qwen 3 8B (Non-reasoning)88.21
9Qwen 3 8B (Thinking)88.01

Interactive version: theaggregate.ai/benchmark?slug=hpr-bench-profile-summarization-tag-coverage · How It Works · Data refreshed daily, snapshot 2026-09-25.