MHG-Mem Study - A-Mem - WorldMemArena-S F1: leaderboard
MHG-Mem Study:fixed A-Mem memory system, three backbones, same environment, mean of 3 runs, temperature 0 and 65,536 token limit; GPT-5.4-mini judge, Qwen served through vLLM on four A800 GPUs. MemEye MCQ exact match, open-answer BLEU/Judge, other benchmarks F1. WorldMemArena-S is a subset; memory systems remain separate protocols. Score (%).
Metric: Score (%). Source: arxiv.org. Saturation forecast: Around December 2027. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4.1 Mini | 33.39 | #351 |
| 2 | Qwen 3.8 27B | 27.99 | #118 |
No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=mhg-mem-study-a-mem-worldmemarena-s-f1 · How It Works · Data refreshed daily, snapshot 2026-10-23.