Decompiled Malware Classification (Multi-View): leaderboard

Metric: Malicious-class F1 (%; 100 C programs, 50 benign utilities and 50 malware samples, compiled with gcc -O2 and stripped; the model reads both decompilations in one prompt and returns a benign or malicious label after a brief rationale; mean of five runs at temperature 0.6). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.

Top models

#ModelScore
1Claude Haiku 4.592.5
2Llama 3.3 70B Instruct88.9
3Gemini 2.5 Flash Lite88.9
4Gemini 2.5 Pro85.4
5GPT-5.4 Mini79.5
6Qwen 3.6 35B A3B78

Interactive version: theaggregate.ai/benchmark?slug=decompiled-malware-classification-multi-view · How It Works · Data refreshed daily, snapshot 2026-09-26.