ENC-Bench - Bearing Calculation: leaderboard

Metric: Acc@20 degrees accuracy (%): share of ENC-Bench spatial reasoning answers with a computed true bearing between two marked points within 20 degrees of the truth (1,161 questions), numeric answers on ENC-Bench's 840 NOAA S-57 electronic navigational charts rendered with OpenCPN in day, dusk and night palettes at six scales, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3 VL 235B A22B (Thinking)55.64#228 (Qwen 3 VL 235B A22B)
2Gemini 2.5 Pro46.86#145
3Qwen 3 VL 32B (Thinking)44.1#287 (Qwen 3 VL 32B)
4InternVL3-38B41.09#395
5Qwen 3 VL 235B A22B Instruct36.95#264
6Gemini 2.5 Flash28.77#237
7GLM-4.5V28.6#339
8Qwen 3 VL 32B Instruct26.44#276
9GPT-4o25.15#333
10Llama 4 Maverick Instruct14.9#439

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=enc-bench-bearing-calculation · How It Works · Data refreshed daily, snapshot 2026-10-11.