MemDrift - Resource Frugality: leaderboard
Memory-induced tool drift (MemDrift, Dabas et al., 2026) from cost-conscious, frugal preferences stored in the agent memory, over 21 professional tool-call scenarios with the memories injected into the system prompt. Claude Opus 4.6 rates, from 1 (unchanged) to 5, how far five tool calls with these irrelevant memories deviate from five calls with no memory; lower is better.
Metric: Deflection score under biased memory (1-5; Claude Opus 4.6 judge compares five tool calls against the no-memory calls, 1 = unchanged), direct memory injection, Resource Frugality bias (21 scenarios). Source: arxiv.org. Saturation forecast: Around August 2028. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 (Medium) | 4.14 | #172 (GPT-5.2) |
| 2 | GPT-5.4 (Medium) | 4.24 | #121 (GPT-5.4) |
| 3 | Kimi K2.5 (Thinking) | 4.67 | #252 (Kimi K2.5) |
| 4 | Qwen 3.5 397B A17B (Thinking) | 4.67 | #242 (Qwen 3.5 397B A17B) |
| 5 | Gemini 2.5 Pro (Medium) | 4.81 | #262 (Gemini 2.5 Pro) |
| 6 | Gemini 3.1 Pro (Preview) (Medium) | 4.91 | #91 (Gemini 3.1 Pro (Preview)) |
| 7 | Claude Sonnet 4.5 | 4.95 | #244 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=memdrift-resource-frugality · How It Works · Data refreshed daily, snapshot 2026-11-12.