AVTrace - Cat2 Event-span Grounding - F1@tIoU.7: leaderboard
AVTrace Cat2: Event-span temporal grounding, measured by F1@tIoU.7 (0–1) over 1,000 test questions. Five off-the-shelf omni-model runs use greedy decoding with 512 new tokens; source-native interfaces expose full clips, sampled frames/audio, or only 30 seconds depending on the model. A reference-blind Qwen3.5-27B normalizes answers before deterministic scoring against partly model-assisted silver references. Invalid answers receive zero; exact checkpoint revisions remain unreported.
Metric: F1@tIoU.7 (0–1). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen3-Omni-30B (AVTrace Run: paper v1 off-the-shelf; full clips via native interface; greedy 512 tokens; exact checkpoint unreported) | 0.13 | |
| 2 | MiniCPM-o-4.5 (AVTrace Run: paper v1 off-the-shelf; full clips via native interface; greedy 512 tokens; exact checkpoint unreported) | 0.04 | |
| 3 | gemma-4-E4B-it (AVTrace Run: paper v1 off-the-shelf; first 30 seconds; greedy 512 tokens; exact checkpoint unreported) | 0.01 | |
| 4 | Qwen2.5-Omni-3B (AVTrace Run: paper v1 off-the-shelf; up to 300 uniform frames and 300-second audio window; greedy 512 tokens; exact checkpoint unreported) | 0.01 | |
| 5 | InteractiveOmni-4B (AVTrace Run: paper v1 off-the-shelf; first 30 seconds; greedy 512 tokens; exact checkpoint unreported) | 0 |
Interactive version: theaggregate.ai/benchmark?slug=avtrace-cat2-event-span-grounding-f1-tiou-7 · How It Works · Data refreshed daily, snapshot 2026-11-05.