SYNCR - Route Planning: leaderboard

Metric: Exact-match accuracy (%) on the SYNCR Route Planning task (planning a route from fragmented egocentric videos), zero-shot four-option multiple choice over 2 to 4 labelled input videos, exact match, deterministic decoding, on the paper's balanced subset of 200 questions per task; chance is 25; higher is better. Source: arxiv.org. Saturation forecast: Around June 2027. 19 models tracked.

Top models

#ModelScore
1GPT-5.444
2Gemini 3 Flash36
3Qwen 3 VL 32B Instruct29.5
4Qwen 2.5 VL 72B Instruct22.5
5Qwen 2.5 VL 7B Instruct21.5
6Qwen 2.5 VL 32B Instruct21.5
7Qwen 3 VL 8B Instruct14.5
8Qwen 3 VL 4B Instruct13

Interactive version: theaggregate.ai/benchmark?slug=syncr-route-planning · How It Works · Data refreshed daily, snapshot 2026-10-07.