Context Arena MRCR (8-needle): leaderboard

OpenAI MRCR benchmark: finds and distinguishes between 8 identical pieces of information in long conversations (8K–1M tokens). Hardest variant, top models score under 50% AUC@1M.

Metric: AUC@1M (%). Source: contextarena.ai. Status: saturation imminent. 52 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Preview) (High)49.4
2Gemini 3.1 Pro (Preview) (Medium)48.5
3Gemini 3.1 Pro (Preview) (High)47.5
4Gemini 3.1 Pro (Preview) (Low)47
5Gemini 3 Flash (Preview) (Medium)45.9
6Gemini 3 Pro (Preview)39
7Gemini 3 Flash (Preview)29.3
8Gemini 2.5 Pro (Preview 06-05)28
9Gemini 2.5 Flash (Preview 05-20)27
10nova-2-lite-v125.3
11GPT-5.2 (xHigh)19
12GPT-4.117.5
13GPT-4.1 Mini16.7
14Grok 4.1 Fast16.5
15GPT-5.215.5

Interactive version: theaggregate.ai/benchmark?slug=context-arena-mrcr-8-needle · How It Works · Data refreshed daily, snapshot 2026-09-05.