HelpBench - Compromise: leaderboard

HelpBench (2026) asks LLMs real-world digital privacy, safety and security help-seeking questions and scores each answer against an expert-written rubric of factual and delivery criteria, applied by a Gemini 2.5 Pro auto-rater and averaged over five responses. This board is the rubric score in percent on questions about compromised accounts and devices, malware and suspicious behavior; higher is better.

Metric: Compromise topic (compromised accounts and devices, malware and suspicious behavior) rubric score (%): points for met positive criteria and avoided negative criteria (factual criteria written per question by privacy, safety and security experts, plus shared delivery criteria) over the maximum points, applied by a Gemini 2.5 Pro auto-rater at temperature 0; chat versions with default parameters, mean of five responses per question; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 18 models tracked.

Top models

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=helpbench-compromise · How It Works · Data refreshed daily, snapshot 2026-11-13.