HiVe-Mem Study - SimpleMem - Mem-Gallery - F1: leaderboard
HiVe-Mem v1 Table1, SimpleMem, Mem-Gallery F1 native0–100. Two unchanged answer backbones,6:2:2train/validation/test,adversarialcasesexcluded,GPT4omini commonjudge. Temperature0,maxoutput512,256tokenhistoryepisodes,Qwen3VLEmbedding2Bretrieval. BaselinesTop7;HiVe5seeds+2expanded,degree4,lambda0. Qwen-trainedselector frozen/transferredtoGPT. ExactGPTsnapshotunreported; no inferred new checkpoint; tokens/latency excluded.
Metric: Score (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 2 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5-mini (HiVe-Mem Run: memory=SimpleMem;temperature=0;output=512) | 33.65 | |
| 2 | Qwen3-VL-4B-Instruct (HiVe-Mem Run: memory=SimpleMem;temperature=0;output=512) | 31.76 |
Interactive version: theaggregate.ai/benchmark?slug=hive-mem-study-simplemem-mem-gallery-f1 · How It Works · Data refreshed daily, snapshot 2026-11-12.