CreditCardQA: leaderboard

Financial numerical reasoning from credit-card agreements. Reports Chain-of-Thought accuracy with a strict ±0.2% numerical tolerance; model sizes remain distinct.

Metric: Chain-of-Thought Accuracy (%, ±0.2% tolerance). Source: arxiv.org. Saturation forecast: Around January 2028. 11 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Pro70.5#80
2GPT-570.4#98
3GPT-OSS-120B70#341
4GPT-5 Mini70#186
5GPT-OSS-20B66.8#518
6GLM-4.665#252
7Kimi K2 (Thinking)64.1#243 (Kimi K2)
8QwQ-32B63.6#421
9DeepSeek R163.3#251
10Llama 3.3 70B62#579

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=creditcardqa · How It Works · Data refreshed daily, snapshot 2026-10-20.