FinRiskAtlas - FinRisk-Ask - Balanced Action Agreement: leaderboard
Balanced agreement (BAcc) with recorded reviewer Ask-or-Proceed decisions on 680 replayed FinRisk-Ask review states, the mean of Ask recall and Proceed recall (FinRiskAtlas, arXiv 2608.25325v1, Appendix Table 11). Percent; higher is better; constant always-ask or always-proceed policies score 50. It measures agreement with one recorded workflow, not a unique optimal policy.
Metric: BAcc (%). Source: arxiv.org. 33 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi K3 | 59.46 | #35 |
| 2 | Qwen 3 8B | 59.39 | #678 |
| 3 | Qwen 3 32B | 58.19 | #449 |
| 4 | Qwen3-Next-80B | 56.21 | #321 |
| 5 | Claude Opus 4.7 | 56.11 | #51 |
| 6 | GPT-5.6 Terra | 56.11 | #40 |
| 7 | Ling-2.6-flash | 56.03 | #533 |
| 8 | Nemotron 3 Ultra | 55.69 | #245 |
| 9 | Kimi K2.5 | 55.68 | #152 |
| 10 | GLM-5 | 55.26 | #149 |
| 11 | Qwen 3 14B | 54.83 | #542 |
| 12 | Qwen 3 4B | 54.68 | #834 |
| 13 | GPT-5.6 Luna | 54.21 | #79 |
| 14 | GPT-5.6 Sol | 54.05 | #22 |
| 15 | Qwen 3 235B A22B | 53.63 | #323 |
Interactive version: theaggregate.ai/benchmark?slug=finriskatlas-finrisk-ask-balanced-action-agreement · How It Works · Data refreshed daily, snapshot 2026-11-05.