GB/T-Bench - Diagnosis Recall - Scope Consistency: leaderboard

GB/T-Bench (arXiv 2608.06312v1): review of 488 Chinese national standard documents seeded with 7,306 errors across 25 error types, by direct LLM review without the authors' multi-agent reviewer. Exact diagnosis recall for errors in the scope review dimension, such as scope statements inconsistent with the content, percent (Table 3). Higher is better.

Metric: Diagnosis recall (%; exact section, dimension and error-type match). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.581.81#33
2GPT-5.6 Sol75.96#22
3Claude Fable 570.87#20
4GPT-5.469.65#83
5Qwen 3.7 Plus67#98
6Gemini 3.5 Flash60.88#66
7DeepSeek V4 Pro60.33#112
8GPT-5.354.3#104
9DeepSeek V4 Flash53.38#155
10GPT-5.4 Mini43.33#228
11Claude Opus 4.841.96#39
12Qwen 2.5 VL 72B Instruct38.39#383
13Qwen 3 235B A22B 2507 Instruct36.11#315
14MiniMax-M2.733.46#270

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=gb-t-bench-diagnosis-recall-scope-consistency · How It Works · Data refreshed daily, snapshot 2026-11-05.