Video-MemComp - VideoMME Long: leaderboard
Video-MemComp v1: streaming evaluation of official development sets. Table 1 mixes reproduced starred rows and results from prior papers; frame sampling and average KV budget differ by system and remain in row identity. Backbone checkpoint revision and decoding are not fully specified; source-qualified systems are retained. This is video QA under cache compression, not an unmodified backbone score. VideoMME Long. Metric: Accuracy (%).
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 15 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Video-MemComp Qwen2-VL-7B [frames 768; KV 100K] | 55.1 | |
| 2 | Video-MemComp Qwen2-VL-7B + InfiniPot-V [frames 768; KV 6K] | 53.4 | |
| 3 | Video-MemComp Qwen2.5-VL-3B + Video-MemComp [frames 768; KV 6K] | 53.2 | |
| 4 | Video-MemComp Qwen2-VL-7B + StreamMem [frames 0.5/0.2fps; KV 6K] | 52.3 | |
| 5 | Video-MemComp Qwen2-VL-7B + DyCoke [frames 768; KV 6K] | 51.7 | |
| 6 | Video-MemComp Qwen2-VL-7B + Video-MemComp [frames 768; KV 6K] | 51.6 | |
| 7 | Video-MemComp Qwen2.5-VL-3B [frames 768; KV 100K] | 50.6 | |
| 8 | Video-MemComp LLaVA-OneVision-7B + StreamMem [frames 0.5/0.2 fps; KV 6K] | 50.1 | |
| 9 | Video-MemComp Qwen2.5-VL-3B + StreamMem [frames 4.0/0.5 fps; KV 6K] | 49.1 | |
| 10 | Video-MemComp LLaVA-OneVision-7B + LiveVLM [frames 0.5/0.2 fps; KV -] | 48.8 |
Interactive version: theaggregate.ai/benchmark?slug=video-memcomp-videomme-long · How It Works · Data refreshed daily, snapshot 2026-10-27.