CoMMET (Text-Complete, With Images) - Belief and Desire: leaderboard

Metric: Story accuracy on the 21 second-order belief and desire StoryTurns among the 399 text-complete StoryTurns of CoMMET (all needed information is in the text), text with the illustrative images; story accuracy (%, a StoryTurn counts only if every question in the multi-turn conversation is answered correctly), open-ended answers judged against the ground truth by Gemini 3.1 Pro; higher is better. Source: arxiv.org. Saturation forecast: Around May 2027. 7 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.457.14#76
2Gemini 3.1 Flash Lite42.86#174
3Llama 4 Maverick38.1#451
4GPT-4o28.57#333
5Claude Opus 4.728.57#45
6Claude Haiku 4.514.29#271
7Llama 3.2 11B Instruct4.76#1112

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=commet-text-complete-with-images-belief-and-desire · How It Works · Data refreshed daily, snapshot 2026-10-11.