Decompiled Malware Classification (RetDec): leaderboard

Metric: Malicious-class F1 (%; 100 C programs, 50 benign utilities and 50 malware samples, compiled with gcc -O2 and stripped; the model reads the RetDec decompilation and returns a benign or malicious label after a brief rationale; mean of five runs at temperature 0.6). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.

Top models

#ModelScore
1Gemini 2.5 Pro90.3
2Claude Haiku 4.588.9
3Llama 3.3 70B Instruct81
4Gemini 2.5 Flash Lite73.4
5Qwen 3.6 35B A3B66.7
6GPT-5.4 Mini61.1

Interactive version: theaggregate.ai/benchmark?slug=decompiled-malware-classification-retdec · How It Works · Data refreshed daily, snapshot 2026-09-26.