TrackThenBind Study - Direct - TOC-Bench: leaderboard
TrackThenBind study:Direct frozen visual-language inference;Direct uses greedy2048newtokens for Instruct/Molmo and16384forThinking,TOC nativebudget;TrackThenBind uses SAM2.1-hiera-large with about11–19calls and a frozen development-chosen configuration,VET50videos/task,real PerceptionTest cups andTOC. TrackThenBind binds a visible object identity then carries it withtracker;this scaffold is separate from direct,thinking and external multi-tool agents. Cited closedmodel scores not re-ingested. Accuracy (%).
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3 VL 32B Instruct | 37.1 | #285 |
| 2 | Qwen 3 VL 32B (Thinking) | 36.9 | #297 (Qwen 3 VL 32B) |
| 3 | Qwen 3 VL 8B (Thinking) | 30 | |
| 4 | Qwen 3 VL 8B Instruct | 25.1 | #418 |
No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=trackthenbind-study-direct-toc-bench · How It Works · Data refreshed daily, snapshot 2026-10-24.