VT-Bench DVM-Car QA - Conditional Mean: leaderboard
Metric: Exact-match accuracy (%; average a numeric attribute over rows filtered relative to the target car; zero-shot at temperature 0). Source: arxiv.org. Saturation forecast: Around December 2026. 8 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash (Preview) | 49.67 |
| 2 | GPT-4.1 | 21.11 |
| 3 | GLM-4.1V-9B (Thinking) | 20.56 |
| 4 | Pixtral-12B | 8.56 |
| 5 | Qwen 3 VL 8B Instruct | 5.78 |
| 6 | InternVL3-8B | 4.33 |
| 7 | Llama 3.2 11B Instruct | 4.33 |
| 8 | Qwen 3 VL 8B (Thinking) | 2.3 |
Interactive version: theaggregate.ai/benchmark?slug=vt-bench-dvm-car-qa-conditional-mean · How It Works · Data refreshed daily, snapshot 2026-09-26.