HotComment - User Behavior Simulation (Text): leaderboard

Metric: User Behavior Simulation score (0-100): the engagement a Qwen3-14B agent simulation of the platform audience (interested and casual users by demographic priors) estimates, for comments generated zero-shot for held-out HotComment test items (a time- and topic-stratified 10% split) on news articles from NetEase News and Tencent News; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 7 models tracked.

Top models

#ModelScore
1GPT-4o72.38

Interactive version: theaggregate.ai/benchmark?slug=hotcomment-user-behavior-simulation-text · How It Works · Data refreshed daily, snapshot 2026-10-07.