CoMMET (Text-Complete, Text Only) - Belief and Emotion: leaderboard

Metric: Story accuracy on the 42 combined belief and emotion StoryTurns among the 399 text-complete StoryTurns of CoMMET (all needed information is in the text), text-only input; story accuracy (%, a StoryTurn counts only if every question in the multi-turn conversation is answered correctly), open-ended answers judged against the ground truth by Gemini 3.1 Pro; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 7 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 4.7100#45
2Claude Haiku 4.597.62#271
3GPT-5.495.24#76
4Gemini 3.1 Flash Lite95.24#174
5GPT-4o92.86#333
6Llama 4 Maverick88.1#451
7Llama 3.2 11B Instruct59.52#1112

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=commet-text-complete-text-only-belief-and-emotion · How It Works · Data refreshed daily, snapshot 2026-10-11.