Loong: leaderboard

Loong — long-context benchmark of multi-document question answering in financial, legal and academic settings where evidence is spread across every document.

Metric: Overall Avg Score (%). Source: github.com. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 1.5 Pro55.37#445
2GPT-4o53.47#343
3Claude 3.5 Sonnet48.85#350
4Claude 3 Haiku44.88#803
5Qwen 2 72B Instruct43.29#576
6GPT-4o Mini42.95#599
7GLM-4 9B Chat38.31#916
8Llama 3.1 8B Instruct36.31#1035

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=loong · How It Works · Data refreshed daily, snapshot 2026-10-20.