ENC-Bench - Symbol Recognition: leaderboard

Metric: Accuracy (%) on ENC-Bench's 384 symbol recognition questions (Perception: naming an isolated IHO chart symbol; four options), on ENC-Bench's 840 NOAA S-57 electronic navigational charts rendered with OpenCPN in day, dusk and night palettes at six scales, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro69.53#145
2Gemini 2.5 Flash63.8#237
3Qwen 3 VL 235B A22B Instruct57.03#264
4InternVL3-38B55.99#395
5Qwen 3 VL 235B A22B (Thinking)54.17#228 (Qwen 3 VL 235B A22B)
6GPT-4o50.78#333
7Qwen 3 VL 32B Instruct50.26#276
8Llama 4 Maverick Instruct47.66#439
9Qwen 3 VL 32B (Thinking)46.88#287 (Qwen 3 VL 32B)
10GLM-4.5V38.8#339

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=enc-bench-symbol-recognition · How It Works · Data refreshed daily, snapshot 2026-10-11.