MMM-Bench - Level 3 (Business Stage): leaderboard

Metric: Macro-F1 (%) at taxonomy level 3 (Business Stage), zero-shot hierarchical classification of the test split (20 percent of 5,990 real Alibaba business documents in 12 domains, mostly Chinese) from OCR text, page images and filename against a flattened five-level taxonomy, temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 15 models tracked.

Top models

#ModelScore
1Gemini 3.1 Pro (Preview)75.91
2Claude Opus 4.673.23
3Claude Opus 4.569.74
4Kimi K2.564.59
5Qwen 3.6 Plus64.51
6GLM-563.95
7GPT-5.462
8GPT-5.260.59
9MiniMax-M2.758.54
10Qwen 3.5 27B56.88
11Qwen 3 VL 235B A22B51.99
12Qwen 3.5 35B A3B49.53
13Qwen 3.5 9B41.02
14Qwen 2.5 VL 7B6.39

Interactive version: theaggregate.ai/benchmark?slug=mmm-bench-level-3-business-stage · How It Works · Data refreshed daily, snapshot 2026-10-07.