EntLORE - Explicit Lookup (Gold Documents): leaderboard
EntLORE (2026) builds an anonymized enterprise world of 2,341 routine documents from an audited truth graph. This board is answer accuracy in percent on its explicit-lookup questions (L1), whose answer is stated in one document, answered through an agent that is handed the gold document paths and reads them through the same tool loop. Higher is better.
Metric: Answer accuracy (%; L1, 469 questions answered by a stated fact; gold-document agentic reference: the gold document paths read through the same agent tool loop; 907 questions over 2,341 anonymized enterprise documents; programmatic scoring for entity, set, count and ordered answers, atomic-claim entailment judged by Claude Opus 4.8 for free-form answers). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GLM-5.2 | 89.2 | #138 |
| 2 | GPT-5.4 | 88.9 | #123 |
| 3 | Claude Sonnet 4.6 (Thinking) | 88.5 | #161 (Claude Sonnet 4.6) |
| 4 | Kimi K2.6 | 88.2 | #178 |
| 5 | GPT-5.4 Mini | 87.5 | #389 |
| 6 | DeepSeek V4 Pro (Reasoning) | 86.4 | #188 (DeepSeek V4 Pro) |
| 7 | DeepSeek V4 Flash (Reasoning) | 85.6 | #258 (DeepSeek V4 Flash) |
| 8 | Qwen 3.5 397B A17B | 85.2 | #246 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=entlore-explicit-lookup-gold-documents · How It Works · Data refreshed daily, snapshot 2026-11-13.