FinEval - Financial Industry Knowledge: leaderboard

FinEval's financial industry knowledge section: short-answer tasks (text classification, sentiment, relation, event and entity extraction) and open-ended generation (summaries, customer portraits, marketing scripts, investment advice). Answers are scored by similarity (%) to the references and the two question types are combined with question-count weights, under zero-shot prompting; higher is better.

Metric: Similarity score (%, zero-shot). Source: github.com. Saturation forecast: Estimated already saturated. 19 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o61.3#741
2Gemini 1.5 Flash61.2#1671
3GPT-4o Mini61.1#1627
4Claude 3.5 Sonnet60.6#747
5Gemini 1.5 Pro60.5#1053
6Qwen 2.5 72B Instruct54.4#1093
7internlm2.5-20B-chat53.2#2563
8GLM-4 9B Chat53.1#2782
9internlm2-chat-20B50.3#2896
10Baichuan2-13B-Chat50.2#6615
11Yi 1.5 34B Chat49.6#2513
12chatglm3-6B48.6#8269
13Qwen 2.5 7B Instruct48.3#2583
14Yi-1.5-9B Chat44.7#4060

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=fineval-financial-industry-knowledge · How It Works · Data refreshed daily, snapshot 2026-11-12.