NovGauge - Multi-Paper Grouping - Method F1: leaderboard

Raw F1 for judging paper similarity on the method dimension (solution approaches) in NovGauge multi-paper similarity grouping on 85 instances with full content (NovGauge, arXiv 2609.11234v1, Table 4). Percent, mean of three runs at the model's maximum reasoning setting; higher is better. Does not check evidence faithfulness; see Verified F1.

Metric: F1 (%). Source: arxiv.org. Saturation forecast: Around June 2027. 12 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Flash Lite70.7#200
2GPT-5.564.6#33
3Kimi K2.663.4#113
4Claude Opus 4.763.3#51
5Claude Sonnet 4.661.3#94
6Gemini 3.1 Pro (Preview)58.7#64
7DeepSeek V4 Pro55.3#112
8Qwen 3.6 Plus53.4#124
9GLM-5.153.2#109
10GPT-5.4 Mini50.4#228
11MiniMax-M2.749.4#270
12DeepSeek V4 Flash48.1#155

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=novgauge-multi-paper-grouping-method-f1 · How It Works · Data refreshed daily, snapshot 2026-11-05.