FinReasoning (Data Alignment) - Reasoning: leaderboard
Metric: Success-weighted score (0-100): the success rate (items whose query ran and whose answer came back in the required format) times the mean of answer accuracy, F1 over the cited data IDs and F1 over the cited fields, on the 400 rule-driven reasoning items (61 executable financial-analysis rules) of FinReasoning's Data Alignment track (answers checked against a structured A-share database by rule); Chinese-language tasks built from A-share research reports, news and market data (2023 to 2025); zero-shot at temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 19 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 68.5 | #91 |
| 2 | Qwen 3 Max | 66.3 | #201 |
| 3 | Qwen 3 32B | 65 | #424 |
| 4 | Kimi K2 | 63.2 | #236 |
| 5 | GPT-4o | 63.1 | #333 |
| 6 | Claude Sonnet 4.5 | 62.7 | #138 |
| 7 | Llama 3.1 70B | 61.3 | #578 |
| 8 | DeepSeek V3 | 60.4 | #312 |
| 9 | GLM-4.6 | 58.4 | #246 |
| 10 | Gemini 3 Pro | 56.8 | #77 |
| 11 | Seed 1.8 | 55.6 | #136 |
| 12 | Qwen 3 8B | 54.2 | #667 |
| 13 | Qwen 3 235B A22B | 54.2 | #304 |
| 14 | Intern-S1 | 53.9 | #278 |
| 15 | Llama 3.1 8B | 42.6 | #1139 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.
Interactive version: theaggregate.ai/benchmark?slug=finreasoning-data-alignment-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-11.