TriggerBench - Positive Clean PM Accuracy (40K Context): leaderboard
TriggerBench (2026) tests prospective memory in conversation: a user states a constraint early in a dialogue, and a later turn creates a situation where a good assistant should act on it unprompted; a judge model scores whether each reply does. Dialogues are stretched to 40K tokens with unrelated turns between the constraint and the trigger. The board is judged accuracy in percent on tasks whose trigger calls for the reminder; higher is better.
Metric: PM accuracy (%) on the 488 positive-clean tasks, where the trigger requires the reminder; dialogues stretched to 40K tokens with unrelated turns injected between constraint and trigger; TriggerBench: 1,265 prospective-memory tasks from 488 dialogue blueprints in five dimensions (state tracking, temporal grounding, logical adherence, attention recovery, safe coding); a constraint is stated early in a dialogue and a later trigger turn calls for acting on it without being asked; GPT-4o (T=0) judges whether the reply fulfils the proactive intent; temperature 0.6; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.2 (High) | 92.62 | #176 (GPT-5.2) |
| 2 | Qwen 3 235B A22B 2507 FP8 (Thinking) | 61.68 | #434 |
| 3 | GPT-4.1 | 51.23 | #495 |
| 4 | Qwen 3 235B A22B 2507 Instruct FP8 | 37.5 | #379 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=triggerbench-positive-clean-pm-accuracy-40k-context · How It Works · Data refreshed daily, snapshot 2026-11-13.