Moondream3.1 Release Comparators - ChartQA: leaderboard
Moondream July 7, 2026 release comparator evaluation. Source prints Qwen3.5 9B, LocateAnything and Gemma4 12B; LocateAnything explicitly uses slow mode to maximize accuracy; vLLM, one H100 SXM5, batch size16, highest accuracy and reasoning settings chosen for each model. Exact checkpoint revisions, precision and reasoning token budgets are not disclosed; keep source-qualified identities and do not infer Max/High/BF16 or merge Base/Instruct variants. Document understanding source labels percent/ANLS; retain native 0–100 presentation. Moondream values are withheld because per-task Lens LoRA versus distilled-base assignment is unresolved; this does not affect these separately printed comparator measurements. No throughput or mixed-average capability board. Metric: ChartQA score (%). Higher is better. Source: https://moondream.ai/blog/moondream-3-1-beyond-benchmarks
Metric: ChartQA score (%). Source: moondream.ai. Saturation forecast: Rough model projection: around 2026. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen3.5 9B [Moondream3.1 release baseline] | 70.72 | |
| 2 | Gemma 4 12B [Moondream3.1 release baseline] | 62.24 |
Interactive version: theaggregate.ai/benchmark?slug=moondream3-1-release-comparators-chartqa · How It Works · Data refreshed daily, snapshot 2026-10-17.