LUNAR - RAG: leaderboard

Personalized response quality retrieving fine-grained behavioral records, averaging GPT-5.1-judged personalization coverage and depth across daily-life domains such as clothing, food, housing and mobility (LUNAR, arXiv 2608.05246v2, Table 4). 1-5 scale; higher is better; 19 models.

Metric: Personalization score (1-5; mean of coverage and depth, GPT-5.1 judge). Source: arxiv.org. Saturation forecast: Around 2029. 19 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.63.15#113
2Gemini 3 Flash (Preview)3.13#90
3GLM-5.13.13#109
4DeepSeek V4 Flash3#155
5MiniMax-M2.72.93#270
6GPT-4.1 Mini2.86#363
7Ling-2.6-1T2.79#307
8DeepSeek V4 Pro2.74#112
9Qwen 3 30B A3B 2507 Instruct2.71#492
10Qwen 3 14B (Non-reasoning)2.68#542 (Qwen 3 14B)
11Ling-2.6-flash2.62#533
12GLM-4.7 Flash2.6#543
13GPT-4o Mini2.58#598
14Qwen 3 8B (Non-reasoning)2.58#678 (Qwen 3 8B)
15Qwen 3 32B (Non-reasoning)2.4#449 (Qwen 3 32B)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=lunar-rag · How It Works · Data refreshed daily, snapshot 2026-11-05.