FinRiskAtlas - FinRisk-Ask - Evidence-Request Alignment: leaderboard

End-to-end evidence-request alignment (ERA) on FinRisk-Ask's replayed professional review states: credit only when a model chooses to ask and its request matches an expert-verified unresolved evidence need, judged on a three-level scale by DeepSeek-V4-Flash (FinRiskAtlas, arXiv 2608.25325v1, Appendix Table 11). Percent; higher is better; the evaluator's self-scored row is excluded.

Metric: ERA (%; DeepSeek-V4-Flash request-alignment judge). Source: arxiv.org. Saturation forecast: Around February 2027. 32 models tracked.

Top models

#ModelScoreOverall rank
1Ling-2.6-1T79.75#307
2GPT-5.6 Luna77.87#79
3Kimi K377.1#35
4Claude Opus 4.775.98#51
5GPT-5.6 Terra75.64#40
6GPT-5.6 Sol67.75#22
7Nemotron 3 Ultra67.75#245
8Kimi K2.566.8#152
9Gemini 3 Flash (Preview)64.49#90
10Qwen 3 235B A22B62.86#323
11Gemini 2.5 Flash62.6#255
12DeepSeek V4 Pro60.29#112
13GPT-5.459.17#83
14GLM-5.258.49#80
15Qwen3-Next-80B57.71#321

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=finriskatlas-finrisk-ask-evidence-request-alignment · How It Works · Data refreshed daily, snapshot 2026-11-05.