OpenVLHarness Study - Base - CountQA: leaderboard
OpenVLHarness (2026): full evaluation splits of 22 visual benchmarks, four models; Base protocol. Scores follow each source task metric (accuracy, F1 or grounding AP), all on 0–100; Average is the published equal-benchmark composite. No across-harness maximum; medium effort is explicit for both GPT models. Published Task Score (%); higher is better.
Metric: Published Task Score (%). Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-6 Astra (Medium) | 82 | #6 (GPT-6 Astra) |
| 2 | GPT-6 Luna (Medium) | 55.17 | #59 (GPT-6 Luna) |
| 3 | Qwen 3 VL 32B Instruct | 44.7 | #282 |
| 4 | Qwen 3 VL 8B Instruct | 32 | #416 |
No result here: #4 Claude Opus 5.5, #7 Gemini 4 Argon, #8 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=openvlharness-study-base-countqa · How It Works · Data refreshed daily, snapshot 2026-10-21.