DSV-Mem: leaderboard

DSV-Mem tests dense stateful visual memory over 1,000 compositional questions in ten professional workflows. Models must reconcile changing visual and textual artifacts, recover past state, derive state and reject stale premises. Total accuracy is item-weighted, averaged over three runs; memory-management and prompt-variant experiments are separate from this baseline.

Metric: Accuracy (%), 1,000 stateful visual-memory questions, mean of three runs. Source: arxiv.org. Saturation forecast: Around May 2027. 14 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 3.7 FlashMedium39.6#42
2Gemini 3.1 Pro (Preview)Medium27.5#102
3Kimi K3High24.3#62
4Gemini 3.6 FlashMedium23#84
5MiniMax-M3Thinking13.1#290
6Qwen 3.5 397B A17BThinking11.3#270
7Qwen 3.5 27BThinking9.6#380
8Gemma 4 31B (IT)8.5#354
9Gemini 3.5 Flash LiteMedium8.2#308
10Qwen 3.5 9BThinking7.2#838
11Kimi K2.5Thinking5.8#272
12Gemma 4 26B A4B (IT)3.9#563
13GLM-4.6VThinking3.4#721
14Qwen 3.5 4BThinking3.3#1270

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=dsv-mem · How It Works · Data refreshed daily, snapshot 2026-11-22.