Insurance Agent Benchmark (Model Alone): leaderboard

Insurance Agent Benchmark (Cooper Labs), phase one: 166 real commercial-lines documents — ACORDs, loss runs, statements of value, policy wordings, submission emails with attachments, scanned and corrupt files — asked one question each and graded by an LLM judge against a human-verified answer key, where an absent or unreadable value must be reported as absent. This board is the raw single call: the file and the question go straight to the model with no scaffold.

Metric: Judge Accuracy (%). Source: www.askcooper.ai. Saturation forecast: Not forecast. 17 models tracked.

Top models

#ModelScoreOverall rank
1Grok 4.677.6#29
2GPT-5.6 Terra76.8#40
3GPT-5.6 Sol76.7#22
4Gemini 3.7 Flash76.7#24
5GPT-5.6 Luna76.5#79
6Gemini 3.8 Flash75.9#30
7Gemini 3.6 Flash74.9#57
8Gemini 3.1 Pro (Preview)74.6#64
9Claude Opus 573.4#16
10Gemini 3.5 Flash Lite73.2#174
11Claude Fable 5.172.9#10
12Claude Sonnet 571.7#65
13Claude Fable 570.7#20
14Claude Opus 4.670.6#67
15Claude Sonnet 4.669.6#94

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=insurance-agent-benchmark-model-alone · How It Works · Data refreshed daily, snapshot 2026-11-05.