NOLLI - Cipher - English: leaderboard

Metric: Accuracy (%). Source: arxiv.org. 15 models tracked.

Top models

#ModelScore
1GPT-5.5 (Medium)95.3
2Claude Opus 4.8 (Medium)93
3Gemini 3.1 Pro (Preview) (Medium)84.7
4DeepSeek V4 Flash74.3
5Gemma 4 31B (IT) (Thinking)66.3
6Qwen 3.5 397B A17B (Non-reasoning)65
7GPT-OSS-120B (Medium)55.7
8EXAONE-4.0-32B (Thinking)35.7
9Qwen 3.5 27B35.3
10Qwen 3.5 9B (Non-reasoning)27.7
11Solar Open 100B21.3
12Llama 3.1 8B Instruct0.7
13Llama 4 Maverick0.7

Interactive version: theaggregate.ai/benchmark?slug=nolli-cipher-english · How It Works · Data refreshed daily, snapshot 2026-09-19.