Fin-Bias: leaderboard

Large language models (LLMs) are increasingly deployed in financial contexts, raising critical concerns about reliability, alignment, and susceptibility to adversarial manipulation. While prior finance-related benchmarks assess LLMs' capabilities in stock trading, they are often restricted to small sample and fail to demonstrate LLM susceptibility to context with potential human bias. We introduce

Metric: Average Herding Score (with rating) (self-reported). Source: benchmarklist.com. 19 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 8B98.3#674
2GLM-4 9B Chat98.1#916
3gemma-7B (IT)97.6#1496
4Gemma 2 27B (IT)97.5#645
5Claude 3.5 Haiku97.1#568
6Gemma 2 9B (IT)97#788
7GPT-495.9#438
8GPT-594.6#98
9Mistral Nemo Instruct (2407)90.8#936
10Claude Sonnet 490.6#199
11internlm2-chat-7B89.1#1121
12Yi-1.5-9B-Chat-16K83.4#1135
13DeepSeek-V2-Lite-Chat78#1210

Interactive version: theaggregate.ai/benchmark?slug=fin-bias · How It Works · Data refreshed daily, snapshot 2026-10-20.