ProEvent: leaderboard

ProEvent (2026) tests proactive agents that keep a user timetable current from ongoing instant-messaging chats with concurrent threads and noise, inserting, updating or deleting events as plans change. Share of 1,279 multi-step cases whose final timetable is entirely correct, in percent; higher is better.

Metric: Timetable success rate (%; share of the 1,279 multi-step cases whose final timetable has every event exactly right after all steps; synthesized instant-messaging chats (1,249 chats, concurrent threads, injected noise) from which a proactive agent must keep the user timetable up to date by inserting, updating or deleting events at each time window). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek R127.2#473
2GPT-5.126.7#229
3DeepSeek V3.218.5#406
4Qwen 3 235B A22B13.6#623
5Qwen 3 8B7.8#1830
6Qwen 3 32B5.9#960

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=proevent · How It Works · Data refreshed daily, snapshot 2026-11-13.