FinFIRST - Source Verification: leaderboard

The source verification rubric of FinFIRST (Wang et al., 2026): the percentage of rubric points for grounding answers to expert-authored financial research questions in authoritative, relevant and time-valid sources. Every model runs in the same ReAct harness with web search, page visit and Python tools, and a GLM-5.1 judge checks each criterion; higher is better.

Metric: Weighted rubric score (%; the 2,085 rubric points for using authoritative, relevant and time-valid sources; 123 expert-authored bilingual financial research tasks, each scored against expert atomic rubric criteria (701 in all, weights summing to 100 per task) by a GLM-5.1 judge validated against finance experts (Cohen kappa 0.816); all models run in the same ReAct harness with web search, page visit and Python tools, temperature 1.0, one run; missing outputs count as failed). Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 589.59#20
2GPT-5.6 Sol88.68#29
3Qwen 3.8 Flash83.36#109
4Ling-3.0-flash-fin82.45#289
5GLM-5.3 Flash80.77#119
6GLM-5.378.56#62
7Qwen 3.8 Max77.75#55
8Qwen 3.8 27B76.83#199
9DeepSeek V4 Pro (0813)73.57#81
10DeepSeek V4 Flash (0731)71.65#136
11Kimi K370.7#53
12GLM-5.268.3#137
13Gemini 3.7 Flash66.62#32
14MiniMax-M362.97#265

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=finfirst-source-verification · How It Works · Data refreshed daily, snapshot 2026-11-12.