BankMathBench (English) - Intermediate: leaderboard

Metric: Exact-match accuracy (%) on the 423 English intermediate (comparison of two products by interest rate or total payout) test questions of BankMathBench, banking calculations on deposits, savings and loans; zero-shot, one instruction format for all models, equivalent number and currency formats accepted; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 23 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-05-13)14.4#316
2Gemini 2.5 Flash11.8#237
3Claude 3.5 Sonnet (20240620)9.9#293
4Qwen 2.5 7B Instruct9#846
5Qwen 3 4B6.6#823
6Phi-3.5-mini-instruct6.4#1148
7Qwen 2.5 3B Instruct5.4#1138
8Qwen 3 8B5#667
9Qwen2.5-Math-7B-Instruct5#1422
10Llama 3.2 3B Instruct3.5#1321
11Qwen 2.5 1.5B Instruct3.1#1388
12DeepSeek R1 Distill Qwen 1.5B2.1#1542
13Llama 3 8B Instruct1.2#1115
14Llama 3.2 1B Instruct0.2#1518
15DeepSeek-R1-Distill-Qwen-7B0.2#1400

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=bankmathbench-english-intermediate · How It Works · Data refreshed daily, snapshot 2026-10-11.