EntLORE - Latent Organizational Reasoning (Gold Documents): leaderboard
EntLORE (2026) builds an anonymized enterprise world of 2,341 routine documents from an audited truth graph. This board is answer accuracy in percent on its latent organizational reasoning questions (L3), whose target relation is stated in no document and must be recovered from routine records, answered through an agent that is handed the gold document paths and reads them through the same tool loop. Higher is better.
Metric: Answer accuracy (%; L3, 234 questions whose target relation is stated in no document; gold-document agentic reference: the gold document paths read through the same agent tool loop; 907 questions over 2,341 anonymized enterprise documents; programmatic scoring for entity, set, count and ordered answers, atomic-claim entailment judged by Claude Opus 4.8 for free-form answers). Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Sonnet 4.6 (Thinking) | 76.3 | #161 (Claude Sonnet 4.6) |
| 2 | DeepSeek V4 Pro (Reasoning) | 73.5 | #188 (DeepSeek V4 Pro) |
| 3 | DeepSeek V4 Flash (Reasoning) | 71.3 | #258 (DeepSeek V4 Flash) |
| 4 | GLM-5.2 | 70.9 | #138 |
| 5 | Kimi K2.6 | 70.6 | #178 |
| 6 | GPT-5.4 | 69.5 | #123 |
| 7 | Qwen 3.5 397B A17B | 62.5 | #246 |
| 8 | GPT-5.4 Mini | 62.1 | #389 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=entlore-latent-organizational-reasoning-gold-documents · How It Works · Data refreshed daily, snapshot 2026-11-13.