Qwen 2.5 1.5B Instruct: benchmark results

Alibaba Qwen 2.5 1.5B instruction-tuned checkpoint. Provider: Alibaba. Released 2024-09-19. Access: Open.

Aggregate Rating 1340 ± 7, rank #1407 of 1656 rated models, from 829 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SLM Trustworthiness - Fairness71.82TrustLLM fairness accuracy (%; sub-task mean)100
LA Leaderboard - ClinTreatES65.27Semantic Answer Similarity (x100)95.5
RobustBench-TC - Authentication Error32.2Tool-call accuracy (%) under the AuthErr perturbation (trans94.1
SLM Trustworthiness - Robustness69.38TrustLLM robustness accuracy (%; sub-task mean)90
SLM Trustworthiness - TrustLLM Overall64.9TrustLLM score (%; mean of ethics, privacy, robustness and f90
Structured Local-Deployment MCQ67.1Strict accuracy (%): share of the 1,085 items answered with 87.5
MERA Code - CodeCorrectness83.69Accuracy (%)86.2
RobustBench-TC - Rate Limit31.7Tool-call accuracy (%) under the RateLim perturbation (trans82.4
LA Leaderboard - PAWS-X Spanish64.05Accuracy (%)77.2
LA Leaderboard - NoticIA22.07ROUGE-1 (%)75.4
EuroEval English NLU - SQuAD83.18Character F1 (%)74.8
Open LLM Leaderboard - MATH Level 522.05Score74.8

Interactive version: theaggregate.ai/model?slug=qwen-2-5-1-5b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.