FinRiskAtlas - Domain Knowledge - Commerce & Payment: leaderboard

Macro-averaged accuracy on the Commerce & Payment group of FinRiskAtlas domain-knowledge task families, a subset of the 42-family knowledge layer used for coarse screening of financial-review models (FinRiskAtlas, arXiv 2608.25325v1, Appendix Table 8). Percent; higher is better; zero-shot direct answers from 33 archived configurations.

Metric: Macro-Averaged Accuracy (%). Source: arxiv.org. Saturation forecast: Around February 2027. 33 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.786.81#51
2Gemini 3 Flash (Preview)86.41#90
3Qwen 3.7 Max86.01#85
4GPT-5.484.34#83
5GPT-5.4 Mini84.34#228
6Kimi K382.8#35
7GPT-5.6 Terra82.73#40
8GPT-5.6 Sol82.42#22
9Qwen 3 235B A22B82.08#323
10DeepSeek V4 Pro81.55#112
11Seed 2.0 Lite81.51#161
12Gemini 2.5 Flash80.51#255
13Kimi K2.580.25#152
14GLM-579.93#149
15Nemotron 3 Ultra79.73#245

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=finriskatlas-domain-knowledge-commerce-payment · How It Works · Data refreshed daily, snapshot 2026-11-05.