CNSL-bench - Video (2 fps): leaderboard
Metric: Accuracy (%) identifying the sign's meaning from its sign language video sampled at 2 frames per second, four-way multiple choice over the 6,707 sign entries of the National Common Sign Language Dictionary (distractors sampled at random), official sampling settings per model, accuracy by exact match of the chosen option; higher is better. Source: arxiv.org. Saturation forecast: Around March 2028. 23 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-5 | 53.42 |
| 2 | Gemini 2.5 Pro (Medium) | 48.32 |
| 3 | Gemini 2.5 Flash | 42.28 |
| 4 | Gemini 2.5 Flash (Non-reasoning) | 36.62 |
| 5 | GPT-4o | 31.26 |
| 6 | Qwen 3 VL 8B Instruct | 30.94 |
| 7 | Qwen 3 VL 8B (Thinking) | 29.88 |
| 8 | Qwen 2 VL 7B Instruct | 29.24 |
| 9 | Qwen 2.5 VL 7B Instruct | 29.1 |
| 10 | GLM-4.1V-9B (Thinking) | 28.03 |
| 11 | GPT-4o Mini | 27.3 |
Interactive version: theaggregate.ai/benchmark?slug=cnsl-bench-video-2-fps · How It Works · Data refreshed daily, snapshot 2026-10-07.