Vals AI MortgageTax: leaderboard
Each item is a mortgage tax certificate supplied as page images with typed and handwritten content. The model returns JSON giving the tax year, county and parcel number, plus the annualised tax due, extrapolated when only part of the year is paid; answers are extracted by pattern matching and checked against labels. Accuracy over a held out set of 938 documents, higher is better; Vals has archived this benchmark.
Metric: Accuracy (%). Source: www.vals.ai. Saturation forecast: Around October 2027. 98 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 5 | 72.06 | #12 |
| 2 | Claude Fable 5.1 | 70.79 | #9 |
| 3 | Claude Opus 4.7 | 70.27 | #49 |
| 4 | Claude Sonnet 5 | 70.03 | #57 |
| 5 | Claude Opus 4.8 | 69.91 | #37 |
| 6 | Gemini 3.1 Pro (Preview) | 69.4 | #58 |
| 7 | Gemini 3 Pro (Preview) | 69.08 | #66 |
| 8 | Gemini 2.5 Pro | 68.92 | #152 |
| 9 | Claude Fable 5 | 68.92 | #16 |
| 10 | GPT-5.5 | 68.76 | #31 |
| 11 | Gemini 3 Flash (Preview) | 68.72 | #82 |
| 12 | Claude 3.7 Sonnet (20250219) | 68.68 | #201 |
| 13 | Gemini 3.5 Flash Lite | 68.68 | #156 |
| 14 | Claude Opus 4.5 (20251101) | 68.68 | #74 |
| 15 | Claude Opus 4.6 (Thinking) | 68.52 | #63 (Claude Opus 4.6) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=vals-ai-mortgagetax · How It Works · Data refreshed daily, snapshot 2026-10-20.