EvolMem - Reproduction: leaderboard
Long-context LLM backbones on multi-session conversational memory, paper v1 Table 2. Seven memory abilities are scored independently; the memory-system ablation table is a separate protocol. Mistral-Large has no pinned endpoint in the paper or released evaluator and retains an explicitly unspecified identity. This series reports Reproduction (%). Source: https://arxiv.org/html/2601.03543v1.
Metric: Reproduction (%). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.1 | 63.6 | #145 |
| 2 | Kimi K2 | 62.26 | #252 |
| 3 | MiniMax-M2 | 61.06 | #327 |
| 4 | DeepSeek V3.2 | 57.26 | #210 |
| 5 | Gemini 3 Pro | 48.4 | #82 |
| 6 | Llama 4 Maverick | 35.31 | #486 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=evolmem-reproduction · How It Works · Data refreshed daily, snapshot 2026-11-05.