FinReasoning (Data Alignment) - Calculation: leaderboard
Metric: Success-weighted score (0-100): the success rate (items whose query ran and whose answer came back in the required format) times the mean of answer accuracy, F1 over the cited data IDs and F1 over the cited fields, on the 800 calculation items (35 indicator formulas across fields, dates and companies) of FinReasoning's Data Alignment track (answers checked against a structured A-share database by rule); Chinese-language tasks built from A-share research reports, news and market data (2023 to 2025); zero-shot at temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around March 2027. 19 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 72.8 | #91 |
| 2 | Gemini 3 Pro | 69.9 | #77 |
| 3 | Kimi K2 | 69.3 | #236 |
| 4 | DeepSeek R1 | 68.9 | #245 |
| 5 | GLM-4.6 | 67.5 | #246 |
| 6 | Qwen 3 Max | 67.1 | #201 |
| 7 | Seed 1.8 | 66.6 | #136 |
| 8 | Claude Sonnet 4.5 | 64.6 | #138 |
| 9 | DeepSeek V3 | 63.7 | #312 |
| 10 | Qwen 3 235B A22B | 63.1 | #304 |
| 11 | Intern-S1 | 62.9 | #278 |
| 12 | Llama 3.1 70B | 61.3 | #578 |
| 13 | GPT-4o | 61 | #333 |
| 14 | Qwen 3 32B | 55.7 | #424 |
| 15 | Qwen 3 8B | 51.8 | #667 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=finreasoning-data-alignment-calculation · How It Works · Data refreshed daily, snapshot 2026-10-11.