ProactEgoMem - Sci ST - Intervention F1: leaderboard
ProactEgoMem Sci: egocentric video proactive assistance; IC object identification,ST state transitions,LT location tracking. Notification and tool-call intervention levels,matching includes semantic judging at temperature 0. Start@0.2 uses matched actions; mIoU counts unmatched opportunities as zero. Backbone effort unspecified; conditional timing errors/SD omitted. Score (%).
Metric: Score (%). Source: arxiv.org. Saturation forecast: Around 2028. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemma 4 31B | 14.9 | #200 |
| 2 | Gemini 2.5 Flash | 13.1 | #242 |
| 3 | Qwen 3.8 27B | 10.9 | #118 |
| 4 | Inkling Small | 8.4 | #160 |
| 5 | Qwen 3.6 27B | 8.2 | #173 |
| 6 | GPT-5.4 Mini | 5 | #212 |
| 7 | Qwen 3.5 9B | 0.5 | #384 |
No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=proactegomem-sci-st-intervention-f1 · How It Works · Data refreshed daily, snapshot 2026-10-23.