EntLORE - Latent Organizational Reasoning (Gold Documents): leaderboard
Metric: Answer accuracy (%; L3, 234 questions whose target relation is stated in no document; gold-document agentic reference: the gold document paths read through the same agent tool loop; 907 questions over 2,341 anonymized enterprise documents; programmatic scoring for entity, set, count and ordered answers, atomic-claim entailment judged by Claude Opus 4.8 for free-form answers). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.6 (Thinking) | 76.3 |
| 2 | DeepSeek V4 Pro (Reasoning) | 73.5 |
| 3 | DeepSeek V4 Flash (Reasoning) | 71.3 |
| 4 | GLM-5.2 | 70.9 |
| 5 | Kimi K2.6 | 70.6 |
| 6 | GPT-5.4 | 69.5 |
| 7 | Qwen 3.5 397B A17B | 62.5 |
| 8 | GPT-5.4 Mini | 62.1 |
Interactive version: theaggregate.ai/benchmark?slug=entlore-latent-organizational-reasoning-gold-documents · How It Works · Data refreshed daily, snapshot 2026-09-29.