Qwen2.5-14B-Vimarckoso-v3: benchmark results

Provider: Alibaba. Access: Open.

Aggregate Rating 1569 ± 32, rank #1413 of 10916 rated models, from 61 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Portuguese LLM - ASSIN2 RTE94.4Macro F1 (%)96.2
Open Portuguese LLM - BLUEX73.99Accuracy (%)95
Open LLM Leaderboard - MuSR48.07Score94.9
Open LLM Leaderboard - GPQA38Score94.8
Open LLM Leaderboard - MMLU-Pro53.43Score93.7
Open Portuguese LLM - OAB Exams61.41Accuracy (%)93.6
Open Portuguese LLM - ENEM79.36Accuracy (%)92.7
Open Japanese LLM - CG62.25Score (%)91.5
Open Portuguese LLM - FaQuAD NLI80.59Macro F1 (%)90.3
Open LLM Leaderboard - MATH Level 540.03Score90.1
Open Japanese LLM - Wiki Coreference SET F18.4Score (%)89.7
Open LLM Leaderboard - BBH64.15Score88.9

Interactive version: theaggregate.ai/model?slug=qwen2-5-14b-vimarckoso-v3 · How It Works · Data refreshed daily, snapshot 2026-11-08.