HugAgent - Direction: leaderboard
HugAgent - Direction. HugAgent EMNLP2026: participant-specific interview context, belief-state/update/direction accuracy and ATI. Released test items from54participants; supplied person context, not the model answering about itself. Six named standalone baselines only; Human ceiling, full-context RAG, Generative Agents and global-majority controls retained in source grid, not model scores. Exact decoding/score scripts linked in native README; no new checkpoint inferred. Metric: Accuracy (%). Higher is better.
Metric: Accuracy (%). Source: jajamoa.github.io. Saturation forecast: Not forecast. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-4o | 82.27 | #741 |
| 2 | DeepSeek R1 | 79.69 | #473 |
| 3 | Llama 3.3 70B | 79.56 | #1498 |
| 4 | Claude Sonnet 4.5 | 78.73 | #250 |
| 5 | Gemini 2.5 Pro | 78.65 | #266 |
| 6 | GPT-5 Mini | 77.02 | #348 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=hugagent-direction · How It Works · Data refreshed daily, snapshot 2026-11-13.