Qwen2.5-Lumen-14B — benchmark results
v000000's preference-tuned (DPO) fine-tune of Qwen2.5-14B-Instruct targeting prompt adherence, storywriting, and roleplay. Provider: Alibaba. Released 2024-09-20. Access: Open.
Unified ELO 1522 ± 14, rank #713 of 1776 rated models, from 130 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MATH Level 5 | 53.63 | Score | 98.6 |
| Open Korean LLM Leaderboard | 785.51 | Average Score (%) | 98.5 |
| Open LLM Leaderboard - IFEval | 80.64 | Score | 98.1 |
| Open Arabic LLM - Aratrust Unfairness | 94.55 | Accuracy (%) | 91 |
| Open Arabic LLM - Aratrust Privacy | 96.49 | Accuracy (%) | 90.4 |
| Open LLM Leaderboard - BBH | 48.51 | Score | 88.8 |
| Open Arabic LLM - Arabic MMLU Computer Science (University) | 78.12 | Accuracy (%) | 88.3 |
| Open Arabic LLM - Alghafa Multiple Choice Grounded Statement Soqal Task | 93.33 | Accuracy (%) | 87.7 |
| Open Arabic LLM - Aratrust MentalHealth | 94.74 | Accuracy (%) | 87.3 |
| Open LLM Leaderboard - MMLU-Pro | 43.36 | Score | 87.2 |
| Open Arabic LLM - Arabic MMLU Computer Science (Middle School) | 92.59 | Accuracy (%) | 87 |
| Open Arabic LLM - Arabic MMLU HT Management | 70.87 | Accuracy (%) | 84.9 |
Interactive version: theaggregate.ai/model?slug=qwen2-5-lumen-14b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.