Qwen2-7B-Multilingual-RP: benchmark results

maywell's multilingual roleplay fine-tune of Qwen2 7B with 32k context, trained on roughly 2B tokens across five languages. Provider: maywell. Released 2024-06-24. Access: Open.

Aggregate Rating 1434 ± 19, rank #1087 of 1661 rated models, from 21 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GSM8K (flexible extract)54.06Exact match, flexible extract (%)88
Open Korean LLM Leaderboard41.68Average Score (%)83.2
Open Ko-LLM Leaderboard41.68Average (%)83.1
Open Portuguese LLM - FaQuAD NLI77.03Macro F1 (%)78.4
Open Korean LLM - Ko-IFEval37.05Strict accuracy, prompt/instruction mean (%)77.5
Open LLM Leaderboard - MATH Level 522.43Score75.6
Open Portuguese LLM - OAB Exams49.75Accuracy (%)74.6
Open Portuguese LLM - ENEM69.21Accuracy (%)72.6
Open Korean LLM - Ko-EQ-Bench24.68EQ-Bench score70.6
Open LLM Leaderboard - MMLU-Pro38.59Score68.7
Open Portuguese LLM - BLUEX57.02Accuracy (%)68.1
Open Portuguese LLM - ASSIN2 RTE91.54Macro F1 (%)67.9

Interactive version: theaggregate.ai/model?slug=qwen2-7b-multilingual-rp · How It Works · Data refreshed daily, snapshot 2026-10-23.