Context Arena MRCR (8-needle): leaderboard

OpenAI MRCR benchmark: finds and distinguishes between 8 identical pieces of information in long conversations (8K–1M tokens). Hardest variant, top models score under 50% AUC@1M.

Metric: AUC@1M (%). Source: contextarena.ai. Saturation forecast: Around November 2027. 52 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash (Preview) (High)49.4#82 (Gemini 3 Flash (Preview))
2Gemini 3.1 Pro (Preview) (Medium)48.5#58 (Gemini 3.1 Pro (Preview))
3Gemini 3.1 Pro (Preview) (High)47.5#58 (Gemini 3.1 Pro (Preview))
4Gemini 3.1 Pro (Preview) (Low)47#58 (Gemini 3.1 Pro (Preview))
5Gemini 3 Flash (Preview) (Medium)45.9#82 (Gemini 3 Flash (Preview))
6Gemini 3 Flash (Preview) (Low)40.9#82 (Gemini 3 Flash (Preview))
7Gemini 3 Pro (Preview)39#66
8Gemini 3 Flash (Preview)29.3#82
9Gemini 2.5 Pro (Preview 06-05)28#106
10Gemini 2.5 Flash (Preview 05-20)27#216
11Nova 2.0 Lite (Non-reasoning)25.3#417 (Nova 2.0 Lite)
12GPT-5.2 (xHigh)19#110 (GPT-5.2)
13GPT-4.117.5#248
14GPT-4.1 Mini16.7#355
15Grok 4.1 Fast16.5#217

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=context-arena-mrcr-8-needle · How It Works · Data refreshed daily, snapshot 2026-10-20.