Kaleidoscope - Text-only: leaderboard
Each vision-language model answers the 9,452 Kaleidoscope exam questions that have no image, in their original language across 18 languages; the score is accuracy averaged over languages with unparseable answers counted wrong. It isolates in-language subject knowledge from the image questions on the Multimodal board.
Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 VL 72B Instruct | 60 | #849 |
| 2 | Qwen 2.5 VL 32B Instruct | 53.77 | #1074 |
| 3 | Aya Vision 32B | 44.73 | #2271 |
| 4 | Qwen 2.5 VL 7B Instruct | 43.91 | #1893 |
| 5 | aya-vision-8B | 39.27 | #4874 |
| 6 | Qwen 2.5 VL 3B Instruct | 38.51 | #2648 |
| 7 | Pangea-7B | 37.84 | #4993 |
| 8 | Molmo 7B-D | 35.12 | #5984 |
No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.
Interactive version: theaggregate.ai/benchmark?slug=kaleidoscope-text-only · How It Works · Data refreshed daily, snapshot 2026-11-17.