ProEvent - Event Success Rate: leaderboard

ProEvent (2026) tests proactive agents that keep a user timetable current from ongoing instant-messaging chats with concurrent threads and noise, inserting, updating or deleting events as plans change. Share of events whose attributes are all correct after multi-step accumulation, in percent; higher is better.

Metric: Event success rate (%; share of events whose attributes are all correct after multi-step accumulation, an event no longer tracked after its first wrong prediction; synthesized instant-messaging chats (1,249 chats, concurrent threads, injected noise) from which a proactive agent must keep the user timetable up to date by inserting, updating or deleting events at each time window). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek R157.7#473
2GPT-5.157.3#229
3DeepSeek V3.247#406
4Qwen 3 235B A22B38.7#623
5Qwen 3 8B30.4#1830
6Qwen 3 32B22.3#960

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=proevent-event-success-rate · How It Works · Data refreshed daily, snapshot 2026-11-13.