CNSL-bench - Illustrative Images: leaderboard

CNSL-bench (2026) evaluates multimodal LLMs on Chinese National Sign Language: each entry of the standardized National Common Sign Language Dictionary is posed as a four-way multiple-choice question from a single input modality. This board is accuracy in percent identifying the sign from the dictionary's illustrative image; higher is better, and chance is 25.

Metric: Accuracy (%) identifying the sign's meaning from the dictionary's illustrative image of the sign, four-way multiple choice over the 6,707 sign entries of the National Common Sign Language Dictionary (distractors sampled at random), official sampling settings per model, accuracy by exact match of the chosen option; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 21 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1GPT-566.96#178
2Gemini 2.5 ProMedium61.13#276
3Gemini 2.5 Flash51.62#463
4Qwen 3 VL Plus43.69#512
5Qwen-VL-Max40.18#1400
6GLM-4.1V-9B (Thinking)39.62
7GPT-4o39.07#751
8Qwen-VL-Plus38.83#5818
9Qwen 3 VL 8B Instruct38.39#1029
10InternVL3.5-8B38.36#1604
11Qwen 3 VL 8B (Thinking)37.56#910
12GPT-4o Mini35.99#1667
13Qwen 3 VL 2B (Thinking)35.37#2535
14Qwen 2.5 VL 3B Instruct34.26#2713
15Qwen 3 VL 2B Instruct34.01#2367

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=cnsl-bench-illustrative-images · How It Works · Data refreshed daily, snapshot 2026-11-21.