OmniTraffic - Special Vehicle Recognition: leaderboard

Metric: Accuracy (%) on special vehicle recognition (detect and classify police cars, ambulances and fire trucks), multiple-choice VQA on the 3,204-item human-verified OmniTraffic test set (12 reconstructed simulated intersections plus real roadside surveillance from South Korea and Tianjin), greedy decoding (at most 500 tokens), exact match against the answer letter with up to three attempts for invalid output (still invalid counts as wrong); higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 11 models tracked.

Top models

#ModelScore
1Gemini 3 Pro88.2
2GPT-5.278.5
3Grok 478.5
4GPT-4o76.5
5Gemini 2.5 Pro72.8
6Qwen 3 VL 235B A22B (Thinking)67.9
7Claude Sonnet 4.5 (Thinking)56.7

Interactive version: theaggregate.ai/benchmark?slug=omnitraffic-special-vehicle-recognition · How It Works · Data refreshed daily, snapshot 2026-09-29.