KhatianDoc - Document QA EM: leaderboard

Metric: Exact match (%; refusal-normalized, 300-item stratified document-QA subset of 1,634 QA pairs, zero-shot). Source: arxiv.org. Saturation forecast: Around 2032. 6 models tracked.

Top models

#ModelScore
1Gemini 2.5 Flash Lite21.67
2Llama 4 Scout18.33
3Qwen 3 VL 8B Instruct13
4Qwen 2.5 VL 72B Instruct0.34
5Gemma 4 26B A4B (IT)0.33
6GPT-4o Mini0

Interactive version: theaggregate.ai/benchmark?slug=khatiandoc-document-qa-em · How It Works · Data refreshed daily, snapshot 2026-09-26.