DocFormBench (MCP-Msoffice): leaderboard

Metric: Format accuracy (%) on DocFormBench: share of required formatting attributes of the 500 content-aware Text-to-Format instances (Chinese and English .docx documents of 12 types) that exactly match the target, averaged per object type (page, paragraph, table, image) and then over types; the MCP-MSOffice baseline (an open-source MCP server that exposes Microsoft Word operations on Windows as structured API calls; default settings, at most 50 inference steps); reasoning (thinking) disabled; higher is better. Source: arxiv.org. Saturation forecast: Around 2029. 7 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Minimal)22.38
2GLM-4.6 (Non-reasoning)18.03
3GLM-4.6V (Non-reasoning)16.38
4DeepSeek V3.2 (Non-reasoning)15.41
5Qwen 3 235B A22B 2507 Instruct14.44
6GPT-5 (Minimal)12.32
7Qwen 3 VL 235B A22B Instruct12.11

Interactive version: theaggregate.ai/benchmark?slug=docformbench-mcp-msoffice · How It Works · Data refreshed daily, snapshot 2026-09-29.