LongBench Pro - Moderate - Non-Thinking: leaderboard

Evaluates long-context understanding across English and Chinese tasks at four difficulty levels. Non-thinking and thinking results use separate published columns; missing settings remain absent. This series reports Moderate - Non-Thinking using Score (%). Source: the original paper result table.

Metric: Score (%). Source: arxiv.org. Saturation forecast: Around February 2027. 34 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash53.99#255
2Claude Sonnet 453.96#207
3Qwen 3 235B A22B 2507 Instruct53.14#315
4DeepSeek V3.251.36#210
5DeepSeek V3 (0324)49.68#349
6Kimi K2 090549.05#292
7DeepSeek V3.148.8#275
8Qwen 3 Next 80B A3B Instruct48.77#381
9Claude 3.7 Sonnet48.38#259
10GPT-4o43.03#357
11GLM-4.640.05#265
12Qwen 3 30B A3B 2507 Instruct39.04#492
13MiniMax-Text-0138.23#519
14GLM-4.536.92#283
15Qwen 3 32B34.3#449

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=longbench-pro-moderate-non-thinking · How It Works · Data refreshed daily, snapshot 2026-11-05.