TriggerBench - PM Accuracy (40K Context): leaderboard
TriggerBench (2026) tests prospective memory in conversation: a user states a constraint early in a dialogue, and a later turn creates a situation where a good assistant should act on it unprompted; a judge model scores whether each reply does. Dialogues are stretched to 40K tokens with unrelated turns between the constraint and the trigger. The board is judged accuracy in percent over all task variants, including controls where acting would be wrong; higher is better.
Metric: PM accuracy (%) over all 1,265 tasks (positive clean, positive overloaded and negative clean variants); dialogues stretched to 40K tokens with unrelated turns injected between constraint and trigger; TriggerBench: 1,265 prospective-memory tasks from 488 dialogue blueprints in five dimensions (state tracking, temporal grounding, logical adherence, attention recovery, safe coding); a constraint is stated early in a dialogue and a later trigger turn calls for acting on it without being asked; GPT-4o (T=0) judges whether the reply fulfils the proactive intent; temperature 0.6; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 (High) | 75.02 | #176 (GPT-5.2) |
| 2 | Qwen 3 235B A22B 2507 FP8 (Thinking) | 52.65 | #434 |
| 3 | GPT-4.1 | 45.22 | #495 |
| 4 | Qwen 3 235B A22B 2507 Instruct FP8 | 40.71 | #379 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=triggerbench-pm-accuracy-40k-context · How It Works · Data refreshed daily, snapshot 2026-11-13.