Hebbia Financial Services Benchmark: leaderboard

Analyst requests answered over document sets, as Excel models or as client-ready decks, run by Hebbia in its production agent harness; the score is the strict pass rate on 151 tasks. The deliverables are files a client would receive, not short answers.

Metric: Strict pass rate on 151 tasks (%). Source: fireworks.ai. Saturation forecast: Around May 2027. 10 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 5.5Max74.6#5
2GPT-6.1 SolMax73.5#10
3GPT-6 AstraMax72.3#6
4DeepSeek V4.1 FlashMax63.1#62
5Gemini 3.8 Flash60.9#36
6Kimi K3Max60.3#56
7DeepSeek V4.1 Flash (1017)Max60.3#41
8Muse Spark OpenMax49#81
9MiniMax-M3.1-FlashMax47#109
10GLM-5.3 FlashMax43.7#125

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=hebbia-financial-services-benchmark · How It Works · Data refreshed daily, snapshot 2026-11-16.