LongVA-7B: benchmark results

Provider: LMMs-Lab. Released 2024-06-24. Access: Open.

Aggregate Rating 1480 ± 27, rank #2664 of 10916 rated models, from 65 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MLVU-Dev - Generation4.33Generation score, GPT-4 judged (0-10)86.2
VG-LLM Release v3 - VSIRelDirection43.3Accuracy (%)83.3
VLM-3R Release VSI-Bench - Rel. Dir.43.3Accuracy (%)80
MLVU-Test - Sports QA44.4Multiple-choice accuracy (%)76.5
MLVU-Test - Needle QA46.7Multiple-choice accuracy (%)72.1
MLVU-Test - Generation3.91Generation score, GPT-4 judged (0-10)71.9
MLVU-Test - Topic Reasoning81.3Multiple-choice accuracy (%)70.6
MLVU-Test - Action Count23.3Multiple-choice accuracy (%)69.1
DriveSpatial - Understanding35.9Accuracy (%) on the multiple-choice spatial-understanding ta63.6
MLVU-Test - Ego Reasoning39.6Multiple-choice accuracy (%)61.8
MLVU-Test - Plot QA46Multiple-choice accuracy (%)61.8
MLVU-Dev56.3Multiple-choice accuracy (%)60.5

Interactive version: theaggregate.ai/model?slug=longva-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.