Context Arena MRCR (8-needle) — leaderboard

OpenAI MRCR benchmark: finds and distinguishes between 8 identical pieces of information in long conversations (8K–1M tokens). Hardest variant — top models score under 50% AUC@1M.

Metric: AUC@1M (%). Source: contextarena.ai. Status: saturation imminent. 52 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Preview) (High)49.4
2Gemini 3.1 Pro (Preview) (High)47.5
3Gemini 3.1 Pro (Preview) (Low)47
4Gemini 3 Flash (Preview) (Medium)45.9
5Gemini 3 Pro (Preview)39
6Gemini 3 Flash (Preview)29.3
7Gemini 2.5 Pro (Preview 06-05)28
8Gemini 2.5 Flash (Preview 05-20)27
9nova-2-lite-v125.3
10GPT-5.2 (xHigh)19
11GPT-4.117.5
12GPT-4.1 Mini16.7
13Grok 4.1 Fast16.5
14GPT-5.215.5
15Gemini 2.5 Flash Lite (Preview 09-2025)13.6

Interactive version: theaggregate.ai/benchmark?slug=context-arena-mrcr-8-needle · How the rankings work · Data refreshed daily, snapshot 2026-07-22.