RefMem-Bench - Single-Choice: leaderboard

Metric: Answer accuracy (%; four-option single-choice questions; mean of the eight reflective-memory dimensions over the 20,279-question test split; dialogue history with image captions in context, temperature 0). Source: arxiv.org. Saturation forecast: Around December 2026. 5 models tracked.

Top models

#ModelScore
1DeepSeek R1 Distill Qwen 14B54.9
2Qwen 3 VL 8B45

Interactive version: theaggregate.ai/benchmark?slug=refmem-bench-single-choice · How It Works · Data refreshed daily, snapshot 2026-09-26.