MechVQA - Text and Table: leaderboard
MechVQA (2026) tests multimodal LLMs on understanding mechanical engineering drawings, with 20,778 questions on 3,281 drawings scored as accuracy by three LLM judges against reference answers. This board covers the Text and Table subtask of the recognition capability, as accuracy in percent on the test split; higher is better.
Metric: Accuracy (%) on the Text and Table subtask (Recognition capability), MechVQA test split (drawing-level 8:1:1 split of 20,778 questions on 3,281 mechanical drawings), answers judged against the reference by three LLM judges (GPT-OSS-120B, DeepSeek-V3.2, Kimi-k2); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.5 | 97.73 | #267 |
| 2 | Gemini 3 Pro (Preview) | 97.73 | #123 |
| 3 | Qwen 3 VL 32B Instruct | 97.73 | #607 |
| 4 | GLM-4.6V | 97.73 | #721 |
| 5 | Qwen 3 VL Plus | 95.45 | #514 |
| 6 | GPT-5 | 93.18 | #185 |
| 7 | MiMo-VL-7B-SFT | 93.18 | #1097 |
| 8 | Qwen 3 VL 30B A3B Instruct | 90.91 | #903 |
| 9 | Qwen 3 VL 4B Instruct | 88.64 | #1348 |
| 10 | MiniCPM-V-4.5 | 84.09 | #1451 |
| 11 | GPT-4o | 81.82 | #754 |
| 12 | InternVL3.5-8B | 77.27 | #1618 |
| 13 | Gemma 3 27B (IT) | 70.45 | #1341 |
| 14 | GPT-4o Mini | 68.18 | #1680 |
| 15 | Llama 3.2 11B Instruct | 54.55 | #5213 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=mechvqa-text-and-table · How It Works · Data refreshed daily, snapshot 2026-11-22.