VerdictBench: leaderboard

E-commerce platforms have begun recruiting crowdsourced jurors to adjudicate massive volumes of transaction disputes. Unlike formal legal judgment, E-commerce dispute verdicts require grounding pivotal clues from redundant, multi-round, multimodal evidence and making decisions under flexible platform-specific conventions. These characteristics render existing methods insufficient for this scenario

Metric: Accuracy (self-reported). Source: benchmarklist.com. Saturation forecast: Around April 2027. 17 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro63.54#80
2GPT-5.2 Instant63.44#210
3DeepSeek V360.8#321
4Qwen Plus60.55#385
5Claude Opus 4.559.1#83
6Seed-1.656.26#265
7Grok 454.36#181
8Gemini 2.5 Flash Lite52.92#422
9Llama 2 13B50.42#1436
10GLM-450.17#648
11Qwen 3 VL 235B A22B48.43#238
12GPT-5.248.33#110

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=verdictbench · How It Works · Data refreshed daily, snapshot 2026-10-20.