EvolMem - Summarization: leaderboard
Long-context LLM backbones on multi-session conversational memory, paper v1 Table 2. Seven memory abilities are scored independently; the memory-system ablation table is a separate protocol. Mistral-Large has no pinned endpoint in the paper or released evaluator and retains an explicitly unspecified identity. This series reports Summarization (%). Source: https://arxiv.org/html/2601.03543v1.
Metric: Summarization (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | MiniMax-M2 | 71.74 | #327 |
| 2 | Gemini 3 Pro | 68.77 | #82 |
| 3 | GPT-5.1 | 68.77 | #145 |
| 4 | Kimi K2 | 68.27 | #252 |
| 5 | DeepSeek V3.2 | 67 | #210 |
| 6 | Llama 4 Maverick | 44.14 | #486 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=evolmem-summarization · How It Works · Data refreshed daily, snapshot 2026-11-05.