PatRe - Office Action Decision (OA-RO): leaderboard
Metric: Decision accuracy (%): the generated office action's decision (allowance, non-final or final rejection, Ex parte Quayle) matches the examiner's, office action generation under reference oracle: the model also receives the references the examiner and applicant cited and must pick the relevant ones, over PatRe (480 recent USPTO patent examination histories across all eight IPC sections, with office actions, rebuttals, claim versions and cited references), temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5 Mini | 50 |
| 2 | DeepSeek V3.2 | 49.7 |
| 3 | Qwen 3.5 27B | 47.6 |
| 4 | Gemini 2.5 Flash | 46.4 |
| 5 | Llama 3.1 8B Instruct | 45.6 |
| 6 | Gemma 3 27B (IT) | 45.4 |
| 7 | Qwen 3.5 9B | 44.3 |
| 8 | Gemma 3 12B (IT) | 43.4 |
| 9 | GPT-4o Mini | 43.3 |
| 10 | Llama 3.3 70B Instruct | 9.7 |
Interactive version: theaggregate.ai/benchmark?slug=patre-office-action-decision-oa-ro · How It Works · Data refreshed daily, snapshot 2026-10-07.