DialoGPT-medium: benchmark results
Microsoft's DialoGPT dialogue-response model for multi-turn conversations, trained on 147 million multi-turn dialogues from Reddit discussion threads. This release retains its distinct size variant; the dialogue count is not a training-token count. Provider: Microsoft. Access: Open.
Aggregate Rating 1127 ± 16, rank #10406 of 10916 rated models, from 74 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MuSR | 42.87 | Score | 69.3 |
| MMLU-by-task - Abstract Algebra | 31 | Accuracy (%) | 60.2 |
| MMLU-by-task - TruthfulQA MC2 | 47.06 | Accuracy (%) | 60.2 |
| MMLU-by-task - Global Facts | 34 | Accuracy (%) | 58.4 |
| MMLU-by-task - Moral Scenarios | 26.59 | Accuracy (%) | 55.1 |
| MMLU-by-task - College Physics | 24.51 | Accuracy (%) | 48.1 |
| MMLU-by-task - High School Chemistry | 30.05 | Accuracy (%) | 40.5 |
| MMLU-by-task - High School Mathematics | 26.3 | Accuracy (%) | 40 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 47.06 | MC2 (%) (0-shot) | 36.3 |
| MMLU-by-task - Astronomy | 33.55 | Accuracy (%) | 36.2 |
| MMLU-by-task - Elementary Mathematics | 26.72 | Accuracy (%) | 36.2 |
| MMLU-by-task - College Medicine | 31.79 | Accuracy (%) | 36 |
Interactive version: theaggregate.ai/model?slug=dialogpt-medium · How It Works · Data refreshed daily, snapshot 2026-11-08.