FinFIRST - Computation and Answer Formation: leaderboard

The computation and answer formation rubric of FinFIRST (Wang et al., 2026): the percentage of rubric points for calculation, reasoning and an evidence-supported final answer in expert-authored financial research questions. Every model runs in the same ReAct harness with web search, page visit and Python tools, and a GLM-5.1 judge checks each criterion; higher is better.

Metric: Weighted rubric score (%; the 2,893 rubric points for calculation, reasoning and an evidence-supported final answer; 123 expert-authored bilingual financial research tasks, each scored against expert atomic rubric criteria (701 in all, weights summing to 100 per task) by a GLM-5.1 judge validated against finance experts (Cohen kappa 0.816); all models run in the same ReAct harness with web search, page visit and Python tools, temperature 1.0, one run; missing outputs count as failed). Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 582.72#20
2GPT-5.6 Sol81.58#29
3Kimi K377.98#53
4GLM-5.375.77#62
5Gemini 3.7 Flash72.8#32
6Qwen 3.8 Flash71.93#109
7Qwen 3.8 Max69.72#55
8Qwen 3.8 27B66.92#199
9GLM-5.3 Flash66.44#119
10DeepSeek V4 Pro (0813)64.88#81
11Ling-3.0-flash-fin61.25#289
12DeepSeek V4 Flash (0731)55.69#136
13GLM-5.254.37#137
14MiniMax-M346.87#265

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=finfirst-computation-and-answer-formation · How It Works · Data refreshed daily, snapshot 2026-11-12.