HelpBench: leaderboard

HelpBench (2026) asks LLMs real-world digital privacy, safety and security help-seeking questions and scores each answer against an expert-written rubric of factual and delivery criteria, applied by a Gemini 2.5 Pro auto-rater and averaged over five responses. This board is the overall rubric score in percent over all 450 questions; higher is better.

Metric: Overall rubric score (%): points for met positive criteria and avoided negative criteria (factual criteria written per question by privacy, safety and security experts, plus shared delivery criteria) over the maximum points, applied by a Gemini 2.5 Pro auto-rater at temperature 0; chat versions with default parameters, mean of five responses per question, 450 questions; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 18 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.387#197
2GPT-5 Chat87#444
3GPT-4.184#495
4Claude Opus 4.684#102
5Gemini 3 Flash84#164
6Claude Sonnet 4.683#161
7Grok 483#307
8Qwen 3.6 Plus83#222
9Gemini 3.1 Pro (Preview)82#94
10Claude Sonnet 482#400
11GLM-5.182#179
12Gemini 2.5 Pro81#266
13GLM-4.680#486
14Grok 4.2080#297
15DeepSeek V3.2 (Non-reasoning)80#406 (DeepSeek V3.2)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=helpbench · How It Works · Data refreshed daily, snapshot 2026-11-13.