Quyen-Pro-v0.1: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1434 ± 27, rank #4484 of 10916 rated models, from 15 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - GSM8K | 71.04 | Accuracy (%) (5-shot) | 95 |
| Open Korean LLM - Ko-EQ-Bench | 40.04 | EQ-Bench score | 91.4 |
| Open LLM Leaderboard v1 - MMLU | 68.44 | Accuracy (%) (5-shot) | 91.4 |
| Open Korean LLM Leaderboard | 43.93 | Average Score (%) | 89.7 |
| Open Korean LLM - Ko-GSM8K (flexible extract) | 51.4 | Exact match, flexible extract (%) | 85 |
| Open Korean LLM - Ko-GPQA-Diamond | 25.76 | Normalized accuracy (%) | 81.3 |
| Open Korean LLM - KorNAT-Helpful | 49.2 | Normalized accuracy (%) | 77.5 |
| Open Korean LLM - Ko-IFEval | 36.14 | Strict accuracy, prompt/instruction mean (%) | 74.9 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 55.85 | MC2 (%) (0-shot) | 66.4 |
| Open Korean LLM - KorNAT-Harmless | 63.75 | Normalized accuracy (%) | 66.3 |
| Open Korean LLM - Ko-Winogrande | 59.59 | Accuracy (%) | 47.5 |
| Open LLM Leaderboard v1 - WinoGrande | 75.93 | Accuracy (%) (5-shot) | 44.9 |
Interactive version: theaggregate.ai/model?slug=quyen-pro-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.