Llama-3.1-SauerkrautLM-8B-Instruct — benchmark results
VAGO solutions' German-English fine-tune of Llama 3.1 8B Instruct using Spectrum training on 25% of the model's layers. Provider: Meta. Released 2024-07-25. Access: Open.
Unified ELO 1507 ± 42, rank #774 of 1776 rated models, from 7 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - IFEval | 80.17 | Score | 97.5 |
| Open Korean LLM Leaderboard | 515.02 | Average Score (%) | 88.8 |
| Open LLM Leaderboard - MMLU-Pro | 32.12 | Score | 70.1 |
| Open LLM Leaderboard - MATH Level 5 | 19.41 | Score | 70 |
| Open LLM Leaderboard - MuSR | 11.52 | Score | 61.1 |
| Open LLM Leaderboard - BBH | 31 | Score | 55.2 |
| Open LLM Leaderboard - GPQA | 5.37 | Score | 44.9 |
Interactive version: theaggregate.ai/model?slug=llama-3-1-sauerkrautlm-8b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.