RHELM (Long Context) - External Source: leaderboard

Metric: Accuracy (%; 249 external-source (attachment and email) questions, LLM judge, dialogue history plus external sources, full history in a 1M-token context). Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.

Top models

#ModelScore
1GPT-4.1 Mini43.4
2Gemini 2.5 Flash Lite19
3Qwen2.5-14B-Instruct-1M5.2

Interactive version: theaggregate.ai/benchmark?slug=rhelm-long-context-external-source · How It Works · Data refreshed daily, snapshot 2026-09-25.