BankMathBench (English) - Advanced: leaderboard

Metric: Exact-match accuracy (%) on the 399 English advanced (one product under several conditions such as tax, early withdrawal, variable rates and prepayment fees) test questions of BankMathBench, banking calculations on deposits, savings and loans; zero-shot, one instruction format for all models, equivalent number and currency formats accepted; higher is better. Source: arxiv.org. Saturation forecast: Around February 2028. 23 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash10.3#237
2Claude 3.5 Sonnet (20240620)10#293
3GPT-4o (2024-05-13)6.3#316
4Qwen 2.5 7B Instruct2.8#846
5Qwen2.5-Math-7B-Instruct2.5#1422
6Phi-3.5-mini-instruct1#1148
7Qwen 3 8B0.5#667
8Llama 3 8B Instruct0.5#1115
9Qwen 2.5 3B Instruct0.5#1138
10Llama 3.2 3B Instruct0.3#1321
11Qwen 3 4B0.3#823
12Qwen 2.5 1.5B Instruct0.3#1388
13DeepSeek R1 Distill Qwen 1.5B0.3#1542
14Llama 3.2 1B Instruct0#1518
15DeepSeek-R1-Distill-Qwen-7B0#1400

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=bankmathbench-english-advanced · How It Works · Data refreshed daily, snapshot 2026-10-11.