Decompiled Malware Classification (Ghidra): leaderboard

Metric: Malicious-class F1 (%; 100 C programs, 50 benign utilities and 50 malware samples, compiled with gcc -O2 and stripped; the model reads the Ghidra decompilation and returns a benign or malicious label after a brief rationale; mean of five runs at temperature 0.6). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.

Top models

#ModelScore
1Claude Haiku 4.588.9
2Gemini 2.5 Pro83.7
3Qwen 3.6 35B A3B79.5
4Llama 3.3 70B Instruct75
5Gemini 2.5 Flash Lite75
6GPT-5.4 Mini71.8

Interactive version: theaggregate.ai/benchmark?slug=decompiled-malware-classification-ghidra · How It Works · Data refreshed daily, snapshot 2026-09-26.