VoiceLongMemEval - Indirect 140Q - Descriptive with Hint: leaderboard
VoiceLongMemEval tests retrieval of past conversational facts that depend on vocal affect. These text-input experiments compare transcripts alone with descriptions of paralinguistic metadata, averaged over three seeds with five distractor sessions; they do not test raw speech perception. This series reports VoiceLongMemEval - Indirect 140Q - Descriptive with Hint from 2609.00570v1, S5.T6: Accuracy (%). Higher is better.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around October 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.8 | 63.1 | #57 |
| 2 | Claude Sonnet 4.6 | 59.1 | #159 |
| 3 | Qwen 3.5 122B A10B | 57.1 | #335 |
| 4 | GPT-5.5 | 56.2 | #48 |
| 5 | Qwen3-Next-80B | 51.4 | #656 |
| 6 | Gemma 3 12B | 44.5 | #2086 |
| 7 | Llama 3.3 70B | 42.4 | #1590 |
| 8 | Llama 4 Maverick | 28.6 | #1166 |
No result here: #4 Claude Opus 5.5, #5 GPT-6 Astra, #9 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=voicelongmemeval-indirect-140q-descriptive-with-hint · How It Works · Data refreshed daily, snapshot 2026-11-08.