German LLM Index - MMLU-ProX v1.1: leaderboard

German Language LLM Index (dach.peerbench.ai, a PeerBench project, 2026), which reruns every model itself with lm-evaluation-harness: chat template, temperature 0, up to 8,192 generated tokens, thinking models set to minimal reasoning effort where the API allows it and other models run as served. Labels carry (Reasoning off) when the site classed the run as reasoning-off (at most ten reasoning tokens, or under 0.1% of its completion tokens); other rows reasoned at the provider default or at the effort the label names. German MMLU-ProX: professionally translated MMLU-Pro questions with up to ten options across 14 subjects, in the corrected v1.1 set of 11,737 questions, fixed by a model-independent manifest that removes 20 duplicated answer keys from translation collisions, one ambiguous item and one collapsed notation. Accuracy (%), higher is better. Source: https://dach.peerbench.ai/

Metric: Accuracy (%). Source: dach.peerbench.ai. Saturation forecast: Around February 2027. 4 models tracked.

Top models

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=german-llm-index-mmlu-prox-v1-1 · How It Works · Data refreshed daily, snapshot 2026-11-05.