CESBench: leaderboard

CESBench (Zhou et al., 2026) tests large language models on cryptographic engineering security for IoT devices with 380 expert-written items on side-channel and fault attacks, implementation, countermeasures, evaluation and integration. The composite score is the unweighted mean in percent of four task-type scores (multiple-choice accuracy, verdict-gated judgment rubric, scenario rubric and code task success on hidden tests), with open answers scored by a Qwen3.5-397B judge; higher is better.

Metric: Composite score (%; unweighted mean of the four task-type means: multiple-choice accuracy (209), judgment verdict-gated rubric score (67), scenario rubric score (63) and code task success on 572 hidden tests (41); 380 expert-written items on cryptographic engineering security for IoT devices; zero-shot, temperature 0, no tools, provider default reasoning mode; judgment and scenario answers scored by a Qwen3.5-397B judge from outside the evaluated set). Source: arxiv.org. Saturation forecast: Around February 2027. 11 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5.283.6#137
2Kimi K2.682.5#173
3Gemini 3.7 Flash81.4#32
4GPT-5.6 Luna80.8#117
5DeepSeek V4 Pro80.2#181
6MiniMax-M2.573.4#590
7DeepSeek V368.4#705
8Ling-flash-2.061.3#1352
9GLM-4 32B (0414)60#1407
10Llama 4 Maverick59.7#1105
11Hunyuan A13B-Instruct54.4#2021

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=cesbench · How It Works · Data refreshed daily, snapshot 2026-11-12.