FinReasoning (Data Alignment): leaderboard
Metric: Success-weighted score (0-100): the success rate (items whose query ran and whose answer came back in the required format) times the mean of answer accuracy, F1 over the cited data IDs and F1 over the cited fields, averaged over the Verification (600 items), Calculation (800) and Reasoning (400) categories of FinReasoning's Data Alignment track (answers checked against a structured A-share database by rule); Chinese-language tasks built from A-share research reports, news and market data (2023 to 2025); zero-shot at temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around April 2027. 19 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 76.5 | #91 |
| 2 | Qwen 3 Max | 75.2 | #201 |
| 3 | Kimi K2 | 74.2 | #236 |
| 4 | Gemini 3 Pro | 73.7 | #77 |
| 5 | DeepSeek V3 | 72 | #312 |
| 6 | Seed 1.8 | 71.9 | #136 |
| 7 | GPT-4o | 71.5 | #333 |
| 8 | Claude Sonnet 4.5 | 70.9 | #138 |
| 9 | Qwen 3 32B | 70.8 | #424 |
| 10 | Llama 3.1 70B | 70.3 | #578 |
| 11 | Qwen 3 235B A22B | 69.1 | #304 |
| 12 | Intern-S1 | 68.5 | #278 |
| 13 | Qwen 3 8B | 63.2 | #667 |
| 14 | Llama 3.1 8B | 56.7 | #1139 |
| 15 | DeepSeek R1 | 39.1 | #245 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=finreasoning-data-alignment · How It Works · Data refreshed daily, snapshot 2026-10-11.