FinFIRST: leaderboard

FinFIRST (Wang et al., 2026) evaluates financial search agents on 123 expert-authored Chinese and English research questions that need time-valid facts from authoritative sources plus calculations, scored with expert-weighted atomic rubric criteria. The score is the percentage of rubric points satisfied. Every model runs in the same ReAct harness with web search, page visit and Python tools, and a GLM-5.1 judge checks each criterion; higher is better.

Metric: Weighted rubric score (%; Loose Pass, share of the 12,300 expert-weighted rubric points satisfied; 123 expert-authored bilingual financial research tasks, each scored against expert atomic rubric criteria (701 in all, weights summing to 100 per task) by a GLM-5.1 judge validated against finance experts (Cohen kappa 0.816); all models run in the same ReAct harness with web search, page visit and Python tools, temperature 1.0, one run; missing outputs count as failed). Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 587.61#20
2GPT-5.6 Sol85.92#29
3Qwen 3.8 Flash81.23#109
4Kimi K380.83#53
5GLM-5.380.61#62
6Qwen 3.8 Max77.4#55
7Qwen 3.8 27B77.28#199
8Gemini 3.7 Flash76.75#32
9GLM-5.3 Flash76.64#119
10DeepSeek V4 Pro (0813)75.41#81
11Ling-3.0-flash-fin75.07#289
12DeepSeek V4 Flash (0731)71.37#136
13GLM-5.265.89#137
14MiniMax-M360.7#265

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=finfirst · How It Works · Data refreshed daily, snapshot 2026-11-12.