PatentAgentBench - Claude Code - Overall: leaderboard

PatentAgentBench Overall evaluates patent evidence search, comparison, drafting, responses and translation under Claude Code 2.1.251. Its primary Equal Task Mean Score (%) uses the full assigned case denominator, including final failures after up to three execution-failure retries. Harnesses and unreported model effort remain distinct source configurations. The suite has 510 patent cases; its public banks contain 1,311 records because translation's 80 cases contain 881 segment items.

Metric: Equal Task Mean Score (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5 (PatentAgentBench Run: 2610.35031v1; Claude Opus 5; Claude Code 2.1.251; effort unreported)50.3
2GPT-5.6 Sol (PatentAgentBench Run: 2610.35031v1; GPT-5.6-Sol; Claude Code 2.1.251; effort unreported)49.3
3Qwen 3.8 Max (PatentAgentBench Run: 2610.35031v1; Qwen3.8-Max; Claude Code 2.1.251; effort unreported)45.2
4Kimi K3 (PatentAgentBench Run: 2610.35031v1; Kimi K3; Claude Code 2.1.251; effort unreported)42.6
5GLM-5.3 (PatentAgentBench Run: 2610.35031v1; GLM-5.3; Claude Code 2.1.251; effort unreported)40.7
6DeepSeek V4 Pro (PatentAgentBench Run: 2610.35031v1; DeepSeek-V4-Pro; Claude Code 2.1.251; effort unreported)39.7
7MiniMax-M3 (PatentAgentBench Run: 2610.35031v1; MiniMax-M3; Claude Code 2.1.251; effort unreported)34.2

Interactive version: theaggregate.ai/benchmark?slug=patentagentbench-claude-code-overall · How It Works · Data refreshed daily, snapshot 2026-11-05.