FinReportBench: leaderboard

Metric: Provisional hierarchical score (0-100): mean over the 244 bilingual report-generation tasks of S = 100 (g1 + (S1/100) g2) / (d1 + d2), where g1, g2 are the weighted rubric points earned on the 4 report-identity (G1) and 27 institutional-completeness (G2) items, d1, d2 the points available and S1 the G1 percentage, and S = 0 when any of the 4 deliverability (G0) preflight checks fails; pass, partial and fail items earn 1, 0.5 and 0; GPT-5.6 Luna at medium reasoning effort judges extracted text and up to four rendered pages against the frozen 35-item rubric; no-skill condition. Source: arxiv.org. Saturation forecast: Around 2032. 9 models tracked.

Top models

#ModelScore
1MiniMax-M2.722.6
2GLM-5.221.8
3MiniMax-M2.521.1
4DeepSeek V4 Flash20.2
5Qwen 3.7 Max19.1
6DeepSeek V4 Pro18.8
7MiniMax-M318.6
8Kimi K2.617.7
9Qwen 3.6 27B15.1

Interactive version: theaggregate.ai/benchmark?slug=finreportbench · How It Works · Data refreshed daily, snapshot 2026-09-29.