MARINER - Vessel Classification (Macro-F1): leaderboard
Metric: Macro-F1 (%) over vessel categories on MARINER fine-grained vessel classification (63 categories: 35 military, 27 civilian and Other; maritime images from shore, shipboard, UAV and open sources, including fog, ice, night and wave conditions); higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 16 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4.1 | 84.14 |
| 2 | GPT-4o | 80.89 |
| 3 | Gemini 2.5 Flash | 80.36 |
| 4 | Qwen 2.5 VL 72B Instruct | 63.06 |
| 5 | Gemini 2.5 Pro | 59.68 |
| 6 | Qwen 2.5 VL 32B Instruct | 59.22 |
| 7 | InternVL3-78B | 52.78 |
| 8 | Qwen 2.5 VL 7B Instruct | 51.18 |
| 9 | InternVL3-38B | 49.37 |
| 10 | MiniCPM-V-2.6 | 35.92 |
| 11 | InternVL3-8B | 22.03 |
| 12 | InternVL2-8B | 13.67 |
Interactive version: theaggregate.ai/benchmark?slug=mariner-vessel-classification-macro-f1 · How It Works · Data refreshed daily, snapshot 2026-10-07.