Qwen 2.5 3B: benchmark results

Alibaba's 3B model from the Qwen2.5 series (September 2024), pretrained on up to 18T tokens and released under the non-commercial Qwen Research License. Provider: Alibaba. Released 2024-09-19. Access: Open.

Aggregate Rating 1403 ± 10, rank #1211 of 1656 rated models, from 421 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LA Leaderboard - MGSM Spanish18Exact Match (%)100
LA Leaderboard - MGSM Galician16.4Exact Match (%)96.9
LA Leaderboard - XQuAD Spanish77F1 (%)95.4
LA Leaderboard - MGSM Catalan12.8Exact Match (%)93.8
LA Leaderboard - RagQuAS80.86Semantic Answer Similarity (x100)92.6
LA Leaderboard - XQuAD Catalan71.76F1 (%)90.8
NormViz-Bench - Macro F144.6Macro F1 (%)90
LA Leaderboard - PAWS Galician65.7Accuracy (%)89
LA Leaderboard - WNLI Catalan63.38Accuracy (%)86
Relevance as a Vulnerability3.22Agent (self-reported)85.7
LA Leaderboard - Belebele Catalan80.22Accuracy (%)85.3
LA Leaderboard - Belebele Galician79.78Accuracy (%)85.3

Interactive version: theaggregate.ai/model?slug=qwen-2-5-3b · How It Works · Data refreshed daily, snapshot 2026-10-20.