CorpusQA (128K) - Education: leaderboard

Education domain of CorpusQA (Lu et al., Tongyi Lab, 2026) at the 128K-token scale (concatenated corpora of about 92K tokens): 82 analytical questions (filters, rankings, counts and computed values) answered over the whole concatenated corpus of English education documents about universities, with reference answers computed by SQL over fields extracted from every document. Accuracy in percent as judged by DeepSeek-V3 against the reference; higher is better.

Metric: Accuracy (%; 82 questions over English education documents, 128K-token corpora, DeepSeek-V3 judge). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-581.71#163
2DeepSeek R1 052878.05#425
3Gemini 2.5 Pro76.83#262
4MiniMax M1 80k76.83#926
5Gemini 2.5 Flash74.39#452
6GPT-5 Mini (2025-08-07)74.39#341
7Qwen 3 235B A22B 2507 (Thinking)70.73#460
8Qwen 3 30B A3B 2507 (Thinking)64.63#759

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=corpusqa-128k-education · How It Works · Data refreshed daily, snapshot 2026-11-12.