OmniStarPro-Long - LMR (Short Span): leaderboard
Metric: Recall accuracy (%; share of long-range memory recall (LMR) queries, which ask late in the stream for an attribute of an entity or event seen early in it, that a GPT-4o judge marks as matching the ground truth; evidence under 10 minutes before the query; OmniStarPro-Long partition, streams of 10 minutes to over an hour). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | LiveStarPro | 63.4 |
| 2 | LiveStar | 59.5 |
| 3 | MMDuet | 47.8 |
| 4 | VideoLLM-MoD | 42 |
| 5 | VideoLLM-online | 41.2 |
Interactive version: theaggregate.ai/benchmark?slug=omnistarpro-long-lmr-short-span · How It Works · Data refreshed daily, snapshot 2026-09-26.