PriMobiBench - User Profile Construction - Explicit PII: leaderboard

Metric: Profile success rate (%; share of the ground-truth attributes of 50 synthetic user profiles that the model correctly infers after reading every screenshot of a MobiLeak trajectory (320 trajectories across 16 Android apps with 2,960 inserted privacy elements in 25 attribute types), judged for semantic entailment by GPT-5-mini; chain-of-thought prompting; attributes shown explicitly on screen (explicit PII)). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScore
1GPT-5 Mini83.3
2GLM-4.5V76.2
3Gemma 3 27B62.1
4Qwen 2.5 VL 7B58.9

Interactive version: theaggregate.ai/benchmark?slug=primobibench-user-profile-construction-explicit-pii · How It Works · Data refreshed daily, snapshot 2026-09-26.