TRACE Bench - Short-Term Memory: leaderboard

Metric: Memory-probe completion rate (%). Source: arxiv.org. 26 models tracked.

Top models

#ModelScore
1GPT-5.592
2MiMo-V2.591
3Gemma 4 31B (Non-reasoning)90.5
4MiMo-V2.5-Pro90
5MiniMax-M2.788.5
6Kimi K2.5 (Non-reasoning)87.5
7DeepSeek V4 Flash87
8GLM-5 (Non-reasoning)87
9Claude Sonnet 4.686
10Qwen 3 8B (Non-reasoning)85.5
11L3-8B-Stheno-v3.285.43
12Qwen 3.5 27B (Non-reasoning)85
13DeepSeek V4 Pro (Non-reasoning)85
14Mistral Small 3.284.5
15Qwen 3 14B (Non-reasoning)84

Interactive version: theaggregate.ai/benchmark?slug=trace-bench-short-term-memory · How It Works · Data refreshed daily, snapshot 2026-09-19.