SLM Trustworthiness - Robustness: leaderboard

SLM Trustworthiness (Benchmarking Trustworthiness of SLMs, arXiv 2608.11981v1, Tables I, II and IV): TrustLLM evaluation of uncompressed instruction-tuned models from 360M to 8B parameters, the baselines of a pruning, quantization and distillation study. Robustness: mean score on AdvGLUE and AdvInstruction natural-noise tasks plus out-of-distribution detection and generalization, percent. Higher is better.

Metric: TrustLLM robustness accuracy (%; sub-task mean). Source: arxiv.org. Saturation forecast: Estimated already saturated. 11 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.1 8B Instruct71.62#1017
2Qwen 2.5 1.5B Instruct69.38#1393
3Gemma 1.1 7B (IT)68.9#1348
4Qwen 2.5 3B Instruct68.79#1159
5Qwen 2.5 7B Instruct67.05#863
6Llama 3.2 3B Instruct66.42#1327
7Qwen 2.5 0.5B Instruct62.42#1510
8SmolLM2-360M-Instruct60.16#1594
9Llama 3.2 1B Instruct59.43#1518
10h2o-danube3-500m-chat56.85#1574

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=slm-trustworthiness-robustness · How It Works · Data refreshed daily, snapshot 2026-11-05.