PatRe - Office Action Decision (OA-DP): leaderboard
PatRe (2026) models patent examination on 480 recent USPTO cases across all eight IPC sections. Acting as the examiner, the model writes an office action from the claims with no prior art (direct prompting). The score is the percent of office actions whose decision (allowance, non-final or final rejection, Ex parte Quayle) matches the examiner; higher is better.
Metric: Decision accuracy (%): the generated office action's decision (allowance, non-final or final rejection, Ex parte Quayle) matches the examiner's, office action generation under direct prompting: the model writes the office action from the claims (and any preceding rebuttal) with no prior art, over PatRe (480 recent USPTO patent examination histories across all eight IPC sections, with office actions, rebuttals, claim versions and cited references), temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around May 2027. 10 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 Mini | 51.4 | #364 |
| 2 | Gemini 2.5 Flash | 50 | #463 |
| 3 | Qwen 3.5 27B | 48.8 | #375 |
| 4 | DeepSeek V3.2 | 47.6 | #419 |
| 5 | Gemma 3 12B (IT) | 45.1 | #1887 |
| 6 | Qwen 3.5 9B | 41.7 | #828 |
| 7 | Llama 3.1 8B Instruct | 41.4 | #4600 |
| 8 | Gemma 3 27B (IT) | 39.5 | #1324 |
| 9 | GPT-4o Mini | 24.4 | #1667 |
| 10 | Llama 3.3 70B Instruct | 10.2 | #1385 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=patre-office-action-decision-oa-dp · How It Works · Data refreshed daily, snapshot 2026-11-21.