Video-MemComp OVO - SSR: leaderboard
Video-MemComp v1: streaming evaluation of official development sets. Table 1 mixes reproduced starred rows and results from prior papers; frame sampling and average KV budget differ by system and remain in row identity. Backbone checkpoint revision and decoding are not fully specified; source-qualified systems are retained. This is video QA under cache compression, not an unmodified backbone score. Appendix F: choice-based streaming OVO-Bench; Qwen2.5-VL-7B compression hyperparameters tuned for this benchmark, 4K KV versus approximately50K baseline. SSR. Metric: Accuracy (%).
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Video-MemComp LLaVA-NeXT-7B [OVO; frames 64; KV ≈ \approx 10K] | 67.6 | |
| 2 | Video-MemComp LLaVA-OneVision-7B [OVO; frames 64; KV ≈ \approx 10K] | 66.9 | |
| 3 | Video-MemComp Qwen2-VL-7B [OVO; frames 64; KV ≈ \approx 10K] | 65.7 | |
| 4 | Video-MemComp InternVL-V2-8B [OVO; frames 64; KV ≈ \approx 10K] | 57.6 | |
| 5 | Video-MemComp Qwen2.5-VL-7B Video-MemComp [OVO; frames 1fps; KV 4K] | 42.1 | |
| 6 | Video-MemComp Qwen2.5-VL-7B [OVO; frames 1fps; KV ≈ \approx 50K] | 41.9 | |
| 7 | Video-MemComp TimeChat-Online-7B [OVO; frames 1fps; KV ≈ \approx 5K] | 36.5 |
Interactive version: theaggregate.ai/benchmark?slug=video-memcomp-ovo-ssr · How It Works · Data refreshed daily, snapshot 2026-10-27.