llama-3-nectar-dpo-8B: benchmark results
An ibivibiv checkpoint with a published Llama configuration and 32 decoder layers. The model card leaves training details unspecified. Provider: ibivibiv. Released 2024-05-14. Access: Open.
Aggregate Rating 1422 ± 15, rank #1139 of 1656 rated models, from 29 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - GSM8K | 69.9 | Accuracy (%) (5-shot) | 90.8 |
| Open LLM Leaderboard v1 - MMLU | 67.9 | Accuracy (%) (5-shot) | 90.2 |
| Open Korean LLM - Ko-IFEval | 42.95 | Strict accuracy, prompt/instruction mean (%) | 87.3 |
| Open Korean LLM - Ko-EQ-Bench | 34.08 | EQ-Bench score | 83.8 |
| Open Portuguese LLM - OAB Exams | 50.57 | Accuracy (%) | 77.6 |
| Open Portuguese LLM - ENEM | 70.4 | Accuracy (%) | 76.2 |
| Open Korean LLM - Ko-GPQA-Diamond | 25.25 | Normalized accuracy (%) | 75.9 |
| Open Korean LLM - KorNAT-Helpful | 48.98 | Normalized accuracy (%) | 75.4 |
| Open Portuguese LLM - FaQuAD NLI | 75.16 | Macro F1 (%) | 72.9 |
| Open Portuguese LLM - BLUEX | 57.58 | Accuracy (%) | 70.3 |
| Open Korean LLM Leaderboard | 38.71 | Average Score (%) | 68.3 |
| Open Ko-LLM Leaderboard | 38.71 | Average (%) | 68.2 |
Interactive version: theaggregate.ai/model?slug=llama-3-nectar-dpo-8b · How It Works · Data refreshed daily, snapshot 2026-10-20.