NVIDIA LLM Robustness - MMLU-Pro Consistency: leaderboard
The "MMLU-Pro Consistency" subtask of NVIDIA LLM Robustness. A task from the NVIDIA LLM Robustness benchmark, measuring how stable a model's answers are under perturbations, adversarial phrasing and prompt variation.
Metric: Consistency (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Llama 3 70B Instruct | 75.24 | #634 |
| 2 | Llama 3.1 70B Instruct | 73.19 | #561 |
| 3 | Mistral Large 2 (Jul) | 72.31 | #484 |
| 4 | Yi 1.5 34B Chat | 57.31 | #800 |
| 5 | Llama 3.1 8B Instruct | 52.79 | #1035 |
| 6 | Mistral Nemo Instruct (2407) | 51.43 | #936 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=nvidia-llm-robustness-mmlu-pro-consistency · How It Works · Data refreshed daily, snapshot 2026-10-20.