FinRiskAtlas - FinRisk-Ask - Conditional Request Alignment: leaderboard

Conditional request alignment (CRA) in FinRisk-Ask: mean three-level alignment of evidence requests with expert-verified needs, computed only over recorded Ask states where the model chose to ask, judged by DeepSeek-V4-Flash (FinRiskAtlas, arXiv 2608.25325v1, Appendix Table 11). Percent; higher is better; the evaluator's self-scored row is excluded.

Metric: CRA (%; DeepSeek-V4-Flash request-alignment judge). Source: arxiv.org. Saturation forecast: Around February 2027. 32 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.7 Max87.67#85
2Kimi K386.61#35
3Claude Opus 4.785.85#51
4Gemini 3 Flash (Preview)83.55#90
5Gemini 2.5 Flash83.51#255
6GPT-5.6 Terra82.58#40
7Ling-2.6-1T82.58#307
8GPT-5.482.13#83
9Nemotron 3 Ultra82.12#245
10GPT-5.6 Luna81.95#79
11GLM-5.281.58#80
12GPT-5.6 Sol81.27#22
13Kimi K2.579.97#152
14DeepSeek V4 Pro79.7#112
15DeepSeek V3 (0324)79.22#349

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=finriskatlas-finrisk-ask-conditional-request-alignment · How It Works · Data refreshed daily, snapshot 2026-11-05.