Ovis2.5-9B: benchmark results

Provider: Alibaba. Released 2025-08-15. Access: Open.

Aggregate Rating 1574 ± 16, rank #1335 of 10916 rated models, from 115 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FairLens93.8Soundness (%; share of closed-ended answers matching the sou100
FairLens - Healthcare98.5Soundness (%; healthcare-domain closed-ended questions, 8 it100
FairLens - Hiring98.5Soundness (%; hiring-domain closed-ended questions, 21 items100
HallusionBench65.3Overall Score98.7
MathVista82.1Accuracy (%)97.8
SenseBench - Single-Image Description4.75Judge Score Sum (0-6; Prometheus completeness, correctness a96.2
MMStar72.5Accuracy (%)93.2
MIOH - Counting32.7Accuracy (%; counting questions about how many objects there92.6
SenseBench - Paired-Image Description4.21Judge Score Sum (0-6; Prometheus completeness, correctness a90.5
AI2D87.4Accuracy (%)89.4
TableVision - Compositional Arithmetic66.4Exact-match accuracy (%) on L3 analysis, compositional arith88.9
TableVision - Counting58.7Exact-match accuracy (%) on L2 reasoning, counting cells (9288.9

Interactive version: theaggregate.ai/model?slug=ovis2-5-9b · How It Works · Data refreshed daily, snapshot 2026-11-08.