SuperCLUE-Ondevice (September 2025) - Multimodal: leaderboard

SuperCLUE-OnDevice evaluates on-device phone-class models; the roster also scores several large cloud models as reference points. September 2025 edition (2025年9月): multimodal sheet total covering image description, information extraction, object and text recognition, table extraction and visual grounding. Each dated workbook is a separate evaluation round, kept apart from the current board. Score 0-100, higher is better.

Metric: Score. Source: www.superclueai.com. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1GLM-4.5V84.88#358
2Doubao-Seed-1.6-thinking-25071582.06#169
3Gemini 2.5 Pro80.17#159
4Qwen 2.5 VL 7B70.01#641
5Gemma 3 4B55.58#1088

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=superclue-ondevice-september-2025-multimodal · How It Works · Data refreshed daily, snapshot 2026-11-05.