FinED-Bench - Financial Reasoning Errors: leaderboard
Metric: F1 (%; financial reasoning errors: conflicting expression, time contradiction, numerical inconsistency, calculation error, clause conflict; a predicted error counts as correct when the extracted sentence matches or contains the annotated sentence and the error type is classified correctly; the paper's error-detection prompt over each document, reasoning models with thinking on unless marked no thinking). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o | 38 |
| 2 | Qwen 3 14B | 29.1 |
| 3 | Qwen 3 8B | 27.96 |
| 4 | Qwen 3 14B (Non-reasoning) | 16.63 |
| 5 | DeepSeek R1 0528 Qwen3 8B | 13.71 |
| 6 | GPT-4o Mini | 10.98 |
| 7 | Qwen 3 8B (Non-reasoning) | 8.6 |
| 8 | Qwen 2.5 7B Instruct | 3.79 |
| 9 | GPT-3.5 Turbo | 2.41 |
Interactive version: theaggregate.ai/benchmark?slug=fined-bench-financial-reasoning-errors · How It Works · Data refreshed daily, snapshot 2026-09-26.