HypoArena - Machine Learning: leaderboard

The machine learning domain of HypoArena (2026), 218 cases: the Bradley-Terry-Davidson rating, anchored at 1500 with no fixed maximum, from pairwise judgments by seed-2.0-pro of the hypothesis sets each model proposes. Higher is better.

Metric: Rating on the 218 machine learning cases: Bradley-Terry-Davidson rating (base 1500, open-ended) from reference-independent pairwise judgments by seed-2.0-pro, both presentation orders, with the source-derived reference hypothesis set as an anonymous competitor; baseline single-pass generation; higher is better. Source: arxiv.org. Saturation forecast: Around September 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 (High)1650.6#123 (GPT-5.4)
2Claude Opus 4.6 (High)1618.9#102 (Claude Opus 4.6)
3GLM-5.11595#179
4Claude Sonnet 4.6 (High)1579.3#161 (Claude Sonnet 4.6)
5Kimi K2.61562.4#178
6DeepSeek V4 Flash (High)1522.1#258 (DeepSeek V4 Flash)
7DeepSeek V4 Pro (High)1520.1#188 (DeepSeek V4 Pro)
8MiniMax-M2.71505.2#518
9GLM-51450.2#260
10GPT-5.4 Mini (High)1437.4#389 (GPT-5.4 Mini)
11MiniMax-M2.51428.9#582
12Gemini 3 Flash (High)1422.2#164 (Gemini 3 Flash)
13Gemini 3.1 Pro (Preview) (High)1407.5#94 (Gemini 3.1 Pro (Preview))
14Kimi K2.5 (Thinking)1246.5#256 (Kimi K2.5)

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=hypoarena-machine-learning · How It Works · Data refreshed daily, snapshot 2026-11-13.