HypoArena - Safety Investigation: leaderboard

The safety investigation domain of HypoArena (2026), 103 cases: the Bradley-Terry-Davidson rating, anchored at 1500 with no fixed maximum, from pairwise judgments by seed-2.0-pro of the hypothesis sets each model proposes. Higher is better.

Metric: Rating on the 103 safety investigation cases: Bradley-Terry-Davidson rating (base 1500, open-ended) from reference-independent pairwise judgments by seed-2.0-pro, both presentation orders, with the source-derived reference hypothesis set as an anonymous competitor; baseline single-pass generation; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.6 (High)1721.6#161 (Claude Sonnet 4.6)
2Claude Opus 4.6 (High)1668.4#102 (Claude Opus 4.6)
3Kimi K2.61633.5#178
4GPT-5.4 (High)1630.7#123 (GPT-5.4)
5GLM-5.11560#179
6DeepSeek V4 Pro (High)1551.4#188 (DeepSeek V4 Pro)
7DeepSeek V4 Flash (High)1489.3#258 (DeepSeek V4 Flash)
8MiniMax-M2.71453.9#518
9GLM-51445.2#260
10GPT-5.4 Mini (High)1437.7#389 (GPT-5.4 Mini)
11Gemini 3.1 Pro (Preview) (High)1387.2#94 (Gemini 3.1 Pro (Preview))
12MiniMax-M2.51369.7#582
13Kimi K2.5 (Thinking)1289.4#256 (Kimi K2.5)
14Gemini 3 Flash (High)1262.1#164 (Gemini 3 Flash)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=hypoarena-safety-investigation · How It Works · Data refreshed daily, snapshot 2026-11-13.